developer_uid: stark2000s
submission_id: stark2000s-test-axolotl_v1
model_name: just_test
model_group: stark2000s/test_axolotl
status: torndown
timestamp: 2024-08-28T03:12:04+00:00
num_battles: 10862
num_wins: 3398
celo_rating: 1103.04
family_friendly_score: 0.0
submission_type: basic
model_repo: stark2000s/test_axolotl
model_architecture: LlamaForCausalLM
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 512
max_output_tokens: 64
display_name: just_test
is_internal_developer: False
language_model: stark2000s/test_axolotl
model_size: 8B
ranking_group: single
us_pacific_date: 2024-08-27
win_ratio: 0.31283373227766526
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name stark2000s-test-axolotl-v1-mkmlizer
Waiting for job on stark2000s-test-axolotl-v1-mkmlizer to finish
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
stark2000s-test-axolotl-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
stark2000s-test-axolotl-v1-mkmlizer: ║     _____            __           __                                ║
stark2000s-test-axolotl-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
stark2000s-test-axolotl-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
stark2000s-test-axolotl-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
stark2000s-test-axolotl-v1-mkmlizer: ║       /___/                                                         ║
stark2000s-test-axolotl-v1-mkmlizer: ║                                                                     ║
stark2000s-test-axolotl-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
stark2000s-test-axolotl-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
stark2000s-test-axolotl-v1-mkmlizer: ║  https://mk1.ai                                                     ║
stark2000s-test-axolotl-v1-mkmlizer: ║                                                                     ║
stark2000s-test-axolotl-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
stark2000s-test-axolotl-v1-mkmlizer: ║  belonging to:                                                      ║
stark2000s-test-axolotl-v1-mkmlizer: ║                                                                     ║
stark2000s-test-axolotl-v1-mkmlizer: ║  Chai Research Corp.                                                ║
stark2000s-test-axolotl-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
stark2000s-test-axolotl-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
stark2000s-test-axolotl-v1-mkmlizer: ║                                                                     ║
stark2000s-test-axolotl-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
stark2000s-test-axolotl-v1-mkmlizer: Downloaded to shared memory in 35.065s
stark2000s-test-axolotl-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpfyfx30tz, device:0
stark2000s-test-axolotl-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
stark2000s-test-axolotl-v1-mkmlizer: quantized model in 25.961s
stark2000s-test-axolotl-v1-mkmlizer: Processed model stark2000s/test_axolotl in 61.027s
stark2000s-test-axolotl-v1-mkmlizer: creating bucket guanaco-mkml-models
stark2000s-test-axolotl-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
stark2000s-test-axolotl-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/stark2000s-test-axolotl-v1
stark2000s-test-axolotl-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/stark2000s-test-axolotl-v1/config.json
stark2000s-test-axolotl-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/stark2000s-test-axolotl-v1/tokenizer_config.json
stark2000s-test-axolotl-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/stark2000s-test-axolotl-v1/special_tokens_map.json
stark2000s-test-axolotl-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/stark2000s-test-axolotl-v1/tokenizer.json
stark2000s-test-axolotl-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/stark2000s-test-axolotl-v1/flywheel_model.0.safetensors
stark2000s-test-axolotl-v1-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 7/291 [00:00<00:06, 47.18it/s]
Loading 0:   5%|▌         | 16/291 [00:00<00:04, 61.04it/s]
Loading 0:   9%|▊         | 25/291 [00:00<00:03, 66.68it/s]
Loading 0:  12%|█▏        | 34/291 [00:00<00:03, 66.03it/s]
Loading 0:  15%|█▍        | 43/291 [00:00<00:03, 66.91it/s]
Loading 0:  20%|█▉        | 58/291 [00:00<00:02, 80.69it/s]
Loading 0:  24%|██▍       | 70/291 [00:00<00:02, 80.86it/s]
Loading 0:  27%|██▋       | 80/291 [00:01<00:02, 85.24it/s]
Loading 0:  31%|███       | 89/291 [00:02<00:08, 22.69it/s]
Loading 0:  35%|███▌      | 103/291 [00:02<00:05, 32.28it/s]
Loading 0:  38%|███▊      | 112/291 [00:02<00:04, 38.59it/s]
Loading 0:  42%|████▏     | 121/291 [00:02<00:03, 45.36it/s]
Loading 0:  46%|████▌     | 133/291 [00:02<00:02, 53.84it/s]
Loading 0:  49%|████▉     | 142/291 [00:02<00:02, 58.22it/s]
Loading 0:  52%|█████▏    | 151/291 [00:02<00:02, 62.36it/s]
Loading 0:  57%|█████▋    | 166/291 [00:03<00:01, 74.81it/s]
Loading 0:  61%|██████    | 178/291 [00:03<00:01, 78.81it/s]
Loading 0:  64%|██████▍   | 187/291 [00:04<00:04, 24.90it/s]
Loading 0:  69%|██████▉   | 202/291 [00:04<00:02, 35.01it/s]
Loading 0:  73%|███████▎  | 212/291 [00:04<00:01, 42.20it/s]
Loading 0:  76%|███████▋  | 222/291 [00:04<00:01, 49.91it/s]
Loading 0:  80%|███████▉  | 232/291 [00:04<00:01, 54.42it/s]
Loading 0:  85%|████████▍ | 247/291 [00:04<00:00, 67.47it/s]
Loading 0:  89%|████████▉ | 259/291 [00:05<00:00, 71.56it/s]
Loading 0:  92%|█████████▏| 269/291 [00:05<00:00, 76.67it/s]
Loading 0:  97%|█████████▋| 283/291 [00:05<00:00, 78.58it/s]
                                                            

Job stark2000s-test-axolotl-v1-mkmlizer completed after 83.96s with status: succeeded
Stopping job with name stark2000s-test-axolotl-v1-mkmlizer
Pipeline stage MKMLizer completed in 85.68s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.11s
Running pipeline stage ISVCDeployer
Creating inference service stark2000s-test-axolotl-v1
Waiting for inference service stark2000s-test-axolotl-v1 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service stark2000s-test-axolotl-v1 ready after 181.58324933052063s
Pipeline stage ISVCDeployer completed in 182.42s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.6162922382354736s
Received healthy response to inference request in 1.0648372173309326s
Received healthy response to inference request in 1.5355124473571777s
Received healthy response to inference request in 1.2021770477294922s
Received healthy response to inference request in 1.6591253280639648s
5 requests
0 failed requests
5th percentile: 1.0923051834106445
10th percentile: 1.1197731494903564
20th percentile: 1.1747090816497803
30th percentile: 1.2688441276550293
40th percentile: 1.4021782875061035
50th percentile: 1.5355124473571777
60th percentile: 1.567824363708496
70th percentile: 1.6001362800598145
80th percentile: 1.6248588562011719
90th percentile: 1.6419920921325684
95th percentile: 1.6505587100982666
99th percentile: 1.6574120044708252
mean time: 1.4155888557434082
Pipeline stage StressChecker completed in 7.69s
stark2000s-test-axolotl_v1 status is now deployed due to DeploymentManager action
stark2000s-test-axolotl_v1 status is now inactive due to auto deactivation removed underperforming models
stark2000s-test-axolotl_v1 status is now torndown due to DeploymentManager action