submission_id: zonemercy-cogent-nemo-v2-5e6_v14
developer_uid: zonemercy
alignment_samples: 9822
alignment_score: 4.168028763137289
best_of: 16
celo_rating: 1284.52
display_name: 0815v1-1
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
language_model: zonemercy/Cogent-Nemo-v2-5e6
max_input_tokens: 512
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: zonemercy/Cogent-Nemo-v2
model_name: 0815v1-1
model_num_parameters: 12772070400.0
model_repo: zonemercy/Cogent-Nemo-v2-5e6
model_size: 13B
num_battles: 9822
num_wins: 5485
propriety_score: 0.7196885428253615
propriety_total_count: 899.0
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-15T20:52:55+00:00
us_pacific_date: 2024-08-15
win_ratio: 0.5584402362044391
Download Preferencedata
Resubmit model
Running pipeline stage MKMLizer
Starting job with name zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer
Waiting for job on zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer to finish
Stopping job with name zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer
%s, retrying in %s seconds...
Starting job with name zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer
Waiting for job on zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer to finish
Stopping job with name zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer
%s, retrying in %s seconds...
Starting job with name zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer
Waiting for job on zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer to finish
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ _____ __ __ ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ /___/ ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ Version: 0.9.11 ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ https://mk1.ai ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ The license key for the current software has been verified as ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ belonging to: ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ Chai Research Corp. ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ Expiration: 2024-10-15 23:59:59 ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ║ ║
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Failed to get response for submission blend_goner_2024-08-03: ('http://chaiml-elo-alignment-run-3-v19-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:42694->127.0.0.1:8080: read: connection reset by peer\n')
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission v000000-l3-8b-poppy-moon_1166_v4: ('http://v000000-l3-8b-poppy-moon-1166-v4-predictor-default.tenant-chaiml-guanaco.knative.ord1.coreweave.cloud/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: Downloaded to shared memory in 58.778s
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpdubqger5, device:0
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: quantized model in 42.613s
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: Processed model zonemercy/Cogent-Nemo-v2-5e6 in 101.392s
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-cogent-nemo-v2-5e6-v14
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-cogent-nemo-v2-5e6-v14/config.json
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-cogent-nemo-v2-5e6-v14/special_tokens_map.json
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-cogent-nemo-v2-5e6-v14/tokenizer_config.json
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-cogent-nemo-v2-5e6-v14/tokenizer.json
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-cogent-nemo-v2-5e6-v14/flywheel_model.0.safetensors
zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer: Loading 0: 0%| | 0/363 [00:00<?, ?it/s] Loading 0: 1%|▏ | 5/363 [00:00<00:16, 21.27it/s] Loading 0: 3%|▎ | 10/363 [00:00<00:13, 26.54it/s] Loading 0: 4%|▍ | 14/363 [00:00<00:15, 22.72it/s] Loading 0: 5%|▌ | 19/363 [00:00<00:11, 28.83it/s] Loading 0: 6%|▋ | 23/363 [00:01<00:15, 21.26it/s] Loading 0: 7%|▋ | 26/363 [00:01<00:17, 19.11it/s] Loading 0: 9%|▊ | 31/363 [00:01<00:13, 24.66it/s] Loading 0: 10%|▉ | 35/363 [00:01<00:12, 25.93it/s] Loading 0: 11%|█ | 39/363 [00:01<00:12, 26.98it/s] Loading 0: 12%|█▏ | 42/363 [00:01<00:13, 24.20it/s] Loading 0: 13%|█▎ | 46/363 [00:01<00:11, 26.84it/s] Loading 0: 13%|█▎ | 49/363 [00:01<00:11, 27.41it/s] Loading 0: 14%|█▍ | 52/363 [00:02<00:12, 25.91it/s] Loading 0: 15%|█▌ | 55/363 [00:02<00:11, 26.03it/s] Loading 0: 17%|█▋ | 60/363 [00:02<00:11, 27.45it/s] Loading 0: 17%|█▋ | 63/363 [00:02<00:15, 19.99it/s] Loading 0: 18%|█▊ | 66/363 [00:02<00:14, 20.79it/s] Loading 0: 20%|█▉ | 71/363 [00:02<00:11, 24.90it/s] Loading 0: 21%|██ | 75/363 [00:03<00:11, 25.56it/s] Loading 0: 21%|██▏ | 78/363 [00:03<00:12, 23.45it/s] Loading 0: 23%|██▎ | 84/363 [00:03<00:09, 29.14it/s] Loading 0: 24%|██▍ | 88/363 [00:03<00:09, 28.43it/s] Loading 0: 26%|██▌ | 93/363 [00:03<00:08, 31.09it/s] Loading 0: 27%|██▋ | 97/363 [00:03<00:09, 29.42it/s] Loading 0: 28%|██▊ | 101/363 [00:04<00:10, 24.08it/s] Loading 0: 29%|██▊ | 104/363 [00:04<00:12, 21.13it/s] Loading 0: 31%|███ | 111/363 [00:04<00:08, 28.18it/s] Loading 0: 32%|███▏ | 115/363 [00:04<00:09, 27.35it/s] Loading 0: 33%|███▎ | 120/363 [00:04<00:08, 29.54it/s] Loading 0: 34%|███▍ | 124/363 [00:04<00:08, 27.10it/s] Loading 0: 35%|███▍ | 127/363 [00:04<00:09, 26.03it/s] Loading 0: 36%|███▌ | 130/363 [00:05<00:08, 26.50it/s] Loading 0: 37%|███▋ | 133/363 [00:05<00:09, 25.49it/s] Loading 0: 38%|███▊ | 137/363 [00:05<00:08, 26.25it/s] Loading 0: 39%|███▉ | 142/363 [00:05<00:09, 22.50it/s] Loading 0: 40%|███▉ | 145/363 [00:05<00:10, 21.18it/s] Loading 0: 41%|████ | 148/363 [00:05<00:09, 22.86it/s] Loading 0: 42%|████▏ | 151/363 [00:06<00:09, 22.44it/s] Loading 0: 42%|████▏ | 154/363 [00:06<00:08, 23.64it/s] Loading 0: 44%|████▎ | 158/363 [00:06<00:09, 21.55it/s] Loading 0: 45%|████▍ | 163/363 [00:06<00:07, 26.96it/s] Loading 0: 46%|████▌ | 167/363 [00:06<00:08, 23.79it/s] Loading 0: 47%|████▋ | 172/363 [00:06<00:06, 28.05it/s] Loading 0: 48%|████▊ | 176/363 [00:07<00:07, 24.21it/s] Loading 0: 50%|████▉ | 181/363 [00:07<00:06, 28.73it/s] Loading 0: 51%|█████ | 185/363 [00:07<00:09, 19.00it/s] Loading 0: 52%|█████▏ | 190/363 [00:07<00:07, 23.55it/s] Loading 0: 53%|█████▎ | 194/363 [00:07<00:07, 22.08it/s] Loading 0: 55%|█████▍ | 199/363 [00:07<00:06, 26.58it/s] Loading 0: 56%|█████▌ | 203/363 [00:08<00:06, 24.07it/s] Loading 0: 57%|█████▋ | 208/363 [00:08<00:05, 28.36it/s] Loading 0: 58%|█████▊ | 212/363 [00:08<00:05, 25.17it/s] Loading 0: 60%|█████▉ | 217/363 [00:08<00:04, 29.52it/s] Loading 0: 61%|██████ | 222/363 [00:08<00:04, 29.97it/s] Loading 0: 62%|██████▏ | 226/363 [00:09<00:06, 21.00it/s] Loading 0: 63%|██████▎ | 230/363 [00:09<00:06, 20.37it/s] Loading 0: 65%|██████▍ | 235/363 [00:09<00:05, 25.10it/s] Loading 0: 66%|██████▌ | 239/363 [00:09<00:05, 23.30it/s] Loading 0: 68%|██████▊ | 246/363 [00:09<00:03, 29.45it/s] Loading 0: 69%|██████▉ | 250/363 [00:09<00:03, 28.43it/s] Loading 0: 70%|███████ | 255/363 [00:10<00:03, 30.56it/s] Loading 0: 71%|███████▏ | 259/363 [00:10<00:03, 29.15it/s] Loading 0: 72%|███████▏ | 263/363 [00:10<00:04, 24.21it/s] Loading 0: 73%|███████▎ | 266/363 [00:10<00:04, 21.35it/s] Loading 0: 75%|███████▌ | 273/363 [00:10<00:03, 28.34it/s] Loading 0: 76%|███████▋ | 277/363 [00:10<00:03, 27.73it/s] Loading 0: 78%|███████▊ | 282/363 [00:11<00:02, 30.22it/s] Loading 0: 79%|███████▉ | 286/363 [00:11<00:02, 28.99it/s] Loading 0: 80%|████████ | 291/363 [00:11<00:02, 31.51it/s] Loading 0: 81%|████████▏ | 295/363 [00:11<00:02, 29.71it/s] Loading 0: 82%|████████▏ | 299/363 [00:11<00:02, 29.11it/s] Loading 0: 83%|████████▎ | 303/363 [00:11<00:01, 30.49it/s] Loading 0: 85%|████████▍ | 307/363 [00:12<00:02, 20.09it/s] Loading 0: 86%|████████▌ | 311/363 [00:12<00:02, 19.91it/s] Loading 0: 87%|████████▋ | 316/363 [00:12<00:01, 24.63it/s] Loading 0: 88%|████████▊ | 320/363 [00:12<00:01, 22.44it/s] Loading 0: 90%|████████▉ | 325/363 [00:12<00:01, 26.88it/s] Loading 0: 91%|█████████ | 329/363 [00:13<00:01, 23.09it/s] Loading 0: 92%|█████████▏| 334/363 [00:13<00:01, 27.31it/s] Loading 0: 93%|█████████▎| 338/363 [00:13<00:01, 23.78it/s] Loading 0: 94%|█████████▍| 343/363 [00:13<00:00, 27.74it/s] Loading 0: 96%|█████████▌| 347/363 [00:20<00:08, 1.98it/s] Loading 0: 96%|█████████▋| 350/363 [00:20<00:05, 2.50it/s] Loading 0: 97%|█████████▋| 353/363 [00:20<00:03, 3.18it/s] Loading 0: 98%|█████████▊| 357/363 [00:21<00:01, 4.33it/s]
Job zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer completed after 127.27s with status: succeeded
Stopping job with name zonemercy-cogent-nemo-v2-5e6-v14-mkmlizer
Pipeline stage MKMLizer completed in 139.56s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.10s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-cogent-nemo-v2-5e6-v14
Waiting for inference service zonemercy-cogent-nemo-v2-5e6-v14 to be ready
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Tearing down inference service zonemercy-cogent-nemo-v2-5e6-v14
%s, retrying in %s seconds...
Creating inference service zonemercy-cogent-nemo-v2-5e6-v14
Ignoring service zonemercy-cogent-nemo-v2-5e6-v14 already deployed
Waiting for inference service zonemercy-cogent-nemo-v2-5e6-v14 to be ready
Failed to get response for submission zonemercy-acute-nemo-v0-_5087_v2: ('http://zonemercy-acute-nemo-v0-5087-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Tearing down inference service zonemercy-cogent-nemo-v2-5e6-v14
%s, retrying in %s seconds...
Creating inference service zonemercy-cogent-nemo-v2-5e6-v14
Waiting for inference service zonemercy-cogent-nemo-v2-5e6-v14 to be ready
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Inference service zonemercy-cogent-nemo-v2-5e6-v14 ready after 50.374327659606934s
Pipeline stage ISVCDeployer completed in 668.09s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4842541217803955s
Received healthy response to inference request in 2.2369563579559326s
Received healthy response to inference request in 1.9499030113220215s
Received healthy response to inference request in 2.6847403049468994s
Received healthy response to inference request in 1.9151582717895508s
5 requests
0 failed requests
5th percentile: 1.922107219696045
10th percentile: 1.929056167602539
20th percentile: 1.9429540634155273
30th percentile: 2.007313680648804
40th percentile: 2.1221350193023683
50th percentile: 2.2369563579559326
60th percentile: 2.335875463485718
70th percentile: 2.434794569015503
80th percentile: 2.5243513584136963
90th percentile: 2.604545831680298
95th percentile: 2.6446430683135986
99th percentile: 2.6767208576202393
mean time: 2.25420241355896
Pipeline stage StressChecker completed in 12.09s
zonemercy-cogent-nemo-v2-5e6_v14 status is now deployed due to DeploymentManager action
zonemercy-cogent-nemo-v2-5e6_v14 status is now inactive due to auto deactivation removed underperforming models
zonemercy-cogent-nemo-v2-5e6_v14 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics