gryphe-pantheon-rp-1-6-1_2807

submission_id: gryphe-pantheon-rp-1-6-1_2807_v1
developer_uid: Gryphe
best_of: 8
celo_rating: 1243.7
display_name: gryphe-pantheon-rp-1-6-1_2807_v1
family_friendly_score: 0.0
formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '<|im_start|>user\n{prompt}<|im_end|>\n', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.8, 'top_p': 1.0, 'min_p': 0.025, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: False
language_model: Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO
max_input_tokens: 512
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: Gryphe/Pantheon-RP-1.6-1
model_name: gryphe-pantheon-rp-1-6-1_2807_v1
model_num_parameters: 12772070400.0
model_repo: Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO
model_size: 13B
num_battles: 11643
num_wins: 5934
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-31T08:55:37+00:00
us_pacific_date: 2024-08-31
win_ratio: 0.5096624581293481
Resubmit model
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer
Waiting for job on gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer to finish
Stopping job with name gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer
Waiting for job on gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer to finish
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║     _____            __           __                                ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║       /___/                                                         ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║  https://mk1.ai                                                     ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║  belonging to:                                                      ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║  Chai Research Corp.                                                ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: Downloaded to shared memory in 52.666s
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpdmtnvt8v, device:0
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: quantized model in 35.008s
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: Processed model Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO in 87.675s
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: creating bucket guanaco-mkml-models
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-1-2807-v1
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-1-2807-v1/config.json
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-1-2807-v1/special_tokens_map.json
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-1-2807-v1/tokenizer_config.json
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-1-2807-v1/tokenizer.json
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-1-2807-v1/flywheel_model.0.safetensors
gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:10, 35.52it/s]
Loading 0:   4%|▎         | 13/363 [00:00<00:06, 56.22it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:07, 49.09it/s]
Loading 0:   7%|▋         | 25/363 [00:00<00:06, 50.40it/s]
Loading 0:   9%|▊         | 31/363 [00:00<00:06, 53.22it/s]
Loading 0:  10%|█         | 37/363 [00:00<00:06, 49.62it/s]
Loading 0:  12%|█▏        | 43/363 [00:00<00:06, 50.36it/s]
Loading 0:  13%|█▎        | 49/363 [00:00<00:05, 52.46it/s]
Loading 0:  15%|█▌        | 55/363 [00:01<00:06, 48.76it/s]
Loading 0:  17%|█▋        | 61/363 [00:01<00:08, 37.64it/s]
Loading 0:  18%|█▊        | 66/363 [00:01<00:07, 38.97it/s]
Loading 0:  20%|█▉        | 72/363 [00:01<00:06, 43.41it/s]
Loading 0:  21%|██▏       | 78/363 [00:01<00:06, 42.99it/s]
Loading 0:  23%|██▎       | 83/363 [00:01<00:06, 43.32it/s]
Loading 0:  25%|██▍       | 90/363 [00:01<00:05, 48.39it/s]
Loading 0:  26%|██▋       | 96/363 [00:02<00:05, 45.33it/s]
Loading 0:  28%|██▊       | 101/363 [00:02<00:05, 44.33it/s]
Loading 0:  30%|██▉       | 108/363 [00:02<00:05, 50.43it/s]
Loading 0:  31%|███▏      | 114/363 [00:02<00:05, 44.64it/s]
Loading 0:  33%|███▎      | 119/363 [00:02<00:05, 43.31it/s]
Loading 0:  35%|███▍      | 126/363 [00:02<00:04, 47.83it/s]
Loading 0:  36%|███▋      | 132/363 [00:02<00:05, 45.86it/s]
Loading 0:  38%|███▊      | 137/363 [00:02<00:05, 44.20it/s]
Loading 0:  39%|███▉      | 142/363 [00:03<00:06, 34.90it/s]
Loading 0:  40%|████      | 146/363 [00:03<00:06, 35.57it/s]
Loading 0:  41%|████▏     | 150/363 [00:03<00:06, 34.93it/s]
Loading 0:  43%|████▎     | 156/363 [00:03<00:05, 40.50it/s]
Loading 0:  44%|████▍     | 161/363 [00:03<00:04, 42.15it/s]
Loading 0:  46%|████▌     | 166/363 [00:03<00:04, 42.57it/s]
Loading 0:  47%|████▋     | 172/363 [00:03<00:04, 42.29it/s]
Loading 0:  49%|████▉     | 177/363 [00:04<00:04, 41.76it/s]
Loading 0:  51%|█████     | 184/363 [00:04<00:03, 47.24it/s]
Loading 0:  52%|█████▏    | 190/363 [00:04<00:03, 45.12it/s]
Loading 0:  54%|█████▎    | 195/363 [00:04<00:03, 43.91it/s]
Loading 0:  55%|█████▌    | 201/363 [00:04<00:03, 47.93it/s]
Loading 0:  57%|█████▋    | 206/363 [00:04<00:03, 47.55it/s]
Loading 0:  58%|█████▊    | 211/363 [00:04<00:03, 47.26it/s]
Loading 0:  60%|█████▉    | 217/363 [00:04<00:03, 45.55it/s]
Loading 0:  61%|██████▏   | 223/363 [00:05<00:03, 36.13it/s]
Loading 0:  63%|██████▎   | 228/363 [00:05<00:03, 37.14it/s]
Loading 0:  64%|██████▍   | 233/363 [00:05<00:03, 39.34it/s]
Loading 0:  66%|██████▌   | 238/363 [00:05<00:03, 41.40it/s]
Loading 0:  67%|██████▋   | 244/363 [00:05<00:02, 41.28it/s]
Loading 0:  69%|██████▊   | 249/363 [00:05<00:02, 41.70it/s]
Loading 0:  71%|███████   | 256/363 [00:05<00:02, 46.76it/s]
Loading 0:  72%|███████▏  | 262/363 [00:05<00:02, 43.95it/s]
Loading 0:  74%|███████▎  | 267/363 [00:06<00:02, 42.88it/s]
Loading 0:  75%|███████▌  | 274/363 [00:06<00:01, 47.61it/s]
Loading 0:  77%|███████▋  | 280/363 [00:06<00:01, 46.06it/s]
Loading 0:  79%|███████▊  | 285/363 [00:06<00:01, 44.70it/s]
Loading 0:  80%|████████  | 292/363 [00:06<00:01, 49.12it/s]
Loading 0:  82%|████████▏ | 298/363 [00:06<00:01, 47.04it/s]
Loading 0:  84%|████████▎ | 304/363 [00:13<00:20,  2.86it/s]
Loading 0:  85%|████████▍ | 308/363 [00:13<00:15,  3.60it/s]
Loading 0:  86%|████████▌ | 312/363 [00:13<00:11,  4.59it/s]
Loading 0:  88%|████████▊ | 320/363 [00:13<00:05,  7.42it/s]
Loading 0:  90%|████████▉ | 326/363 [00:13<00:03,  9.82it/s]
Loading 0:  91%|█████████ | 331/363 [00:14<00:02, 12.34it/s]
Loading 0:  93%|█████████▎| 338/363 [00:14<00:01, 17.19it/s]
Loading 0:  95%|█████████▍| 344/363 [00:14<00:00, 20.92it/s]
Loading 0:  96%|█████████▌| 349/363 [00:14<00:00, 24.28it/s]
Loading 0:  98%|█████████▊| 356/363 [00:14<00:00, 31.05it/s]
Loading 0: 100%|█████████▉| 362/363 [00:14<00:00, 33.39it/s]
                                                            
Job gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer completed after 116.17s with status: succeeded
Stopping job with name gryphe-pantheon-rp-1-6-1-2807-v1-mkmlizer
Pipeline stage MKMLizer completed in 117.73s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.17s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service gryphe-pantheon-rp-1-6-1-2807-v1
Waiting for inference service gryphe-pantheon-rp-1-6-1-2807-v1 to be ready
Inference service gryphe-pantheon-rp-1-6-1-2807-v1 ready after 251.2535514831543s
Pipeline stage MKMLDeployer completed in 251.72s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5055787563323975s
Received healthy response to inference request in 2.1286990642547607s
Received healthy response to inference request in 2.01308274269104s
Received healthy response to inference request in 1.7044925689697266s
Received healthy response to inference request in 2.738118886947632s
5 requests
0 failed requests
5th percentile: 1.7662106037139893
10th percentile: 1.827928638458252
20th percentile: 1.9513647079467773
30th percentile: 2.036206007003784
40th percentile: 2.0824525356292725
50th percentile: 2.1286990642547607
60th percentile: 2.2794509410858153
70th percentile: 2.43020281791687
80th percentile: 2.5520867824554445
90th percentile: 2.645102834701538
95th percentile: 2.691610860824585
99th percentile: 2.7288172817230225
mean time: 2.2179944038391115
Pipeline stage StressChecker completed in 12.07s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
starting trigger_guanaco_pipeline %s
Pipeline stage TriggerMKMLProfilingPipeline completed in 4.37s
gryphe-pantheon-rp-1-6-1_2807_v1 status is now deployed due to DeploymentManager action
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.12s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service gryphe-pantheon-rp-1-6-1-2807-v1-profiler
Waiting for inference service gryphe-pantheon-rp-1-6-1-2807-v1-profiler to be ready
Inference service gryphe-pantheon-rp-1-6-1-2807-v1-profiler ready after 190.43184757232666s
Pipeline stage MKMLProfilerDeployer completed in 190.80s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
script pods %s
Pipeline stage MKMLProfilerRunner completed in 0.49s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service gryphe-pantheon-rp-1-6-1-2807-v1-profiler is running
Tearing down inference service gryphe-pantheon-rp-1-6-1-2807-v1-profiler
Service gryphe-pantheon-rp-1-6-1-2807-v1-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 1.80s
gryphe-pantheon-rp-1-6-1_2807_v1 status is now inactive due to auto deactivation removed underperforming models
gryphe-pantheon-rp-1-6-1_2807_v1 status is now torndown due to DeploymentManager action