neversleep-noromaid-v0_8068

submission_id: neversleep-noromaid-v0_8068_v151
developer_uid: end_to_end_test
best_of: 4
celo_rating: 1204.06
display_name: neversleep-noromaid-v0_8068_v151
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 0.99, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
ineligible_reason: model is only for e2e test
is_internal_developer: True
language_model: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
max_input_tokens: 512
max_output_tokens: 64
model_architecture: MixtralForCausalLM
model_group: NeverSleep/Noromaid-v0.1
model_name: neversleep-noromaid-v0_8068_v151
model_num_parameters: 46702792704.0
model_repo: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
model_size: 47B
num_battles: 11356
num_wins: 5141
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-09-02T06:04:00+00:00
us_pacific_date: 2024-09-01
win_ratio: 0.45271222261359634
Download Preference Data
Resubmit model
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name neversleep-noromaid-v0-8068-v151-mkmlizer
Waiting for job on neversleep-noromaid-v0-8068-v151-mkmlizer to finish
neversleep-noromaid-v0-8068-v151-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
neversleep-noromaid-v0-8068-v151-mkmlizer: ║     _____            __           __                                ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║       /___/                                                         ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║  Version: 0.10.1                                                    ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║  https://mk1.ai                                                     ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║  The license key for the current software has been verified as      ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║  belonging to:                                                      ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║  Chai Research Corp.                                                ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v151-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
neversleep-noromaid-v0-8068-v151-mkmlizer: Downloaded to shared memory in 183.002s
neversleep-noromaid-v0-8068-v151-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpyyardiyf, device:0
neversleep-noromaid-v0-8068-v151-mkmlizer: Saving flywheel model at /dev/shm/model_cache
neversleep-noromaid-v0-8068-v151-mkmlizer: quantized model in 88.674s
neversleep-noromaid-v0-8068-v151-mkmlizer: Processed model NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3 in 271.676s
neversleep-noromaid-v0-8068-v151-mkmlizer: creating bucket guanaco-mkml-models
neversleep-noromaid-v0-8068-v151-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
neversleep-noromaid-v0-8068-v151-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151
neversleep-noromaid-v0-8068-v151-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151/config.json
neversleep-noromaid-v0-8068-v151-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151/tokenizer_config.json
neversleep-noromaid-v0-8068-v151-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151/special_tokens_map.json
neversleep-noromaid-v0-8068-v151-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151/tokenizer.model
neversleep-noromaid-v0-8068-v151-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151/tokenizer.json
neversleep-noromaid-v0-8068-v151-mkmlizer: cp /dev/shm/model_cache/flywheel_model.3.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151/flywheel_model.3.safetensors
neversleep-noromaid-v0-8068-v151-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151/flywheel_model.0.safetensors
neversleep-noromaid-v0-8068-v151-mkmlizer: cp /dev/shm/model_cache/flywheel_model.2.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151/flywheel_model.2.safetensors
neversleep-noromaid-v0-8068-v151-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v151/flywheel_model.1.safetensors
neversleep-noromaid-v0-8068-v151-mkmlizer: 
Loading 0:   0%|          | 0/995 [00:00<?, ?it/s]
Loading 0:   1%|          | 9/995 [00:00<00:12, 75.87it/s]
Loading 0:   2%|▏         | 17/995 [00:00<00:15, 64.14it/s]
Loading 0:   2%|▏         | 24/995 [00:00<00:19, 50.76it/s]
Loading 0:   3%|▎         | 30/995 [00:00<00:19, 49.47it/s]
Loading 0:   4%|▍         | 40/995 [00:00<00:15, 62.36it/s]
Loading 0:   5%|▍         | 47/995 [00:00<00:16, 57.61it/s]
Loading 0:   5%|▌         | 54/995 [00:02<01:00, 15.50it/s]
Loading 0:   6%|▌         | 59/995 [00:02<00:51, 18.24it/s]
Loading 0:   7%|▋         | 71/995 [00:02<00:32, 28.19it/s]
Loading 0:   8%|▊         | 77/995 [00:02<00:28, 32.04it/s]
Loading 0:   8%|▊         | 83/995 [00:02<00:27, 32.81it/s]
Loading 0:   9%|▉         | 89/995 [00:02<00:24, 37.20it/s]
Loading 0:  10%|█         | 102/995 [00:02<00:17, 50.81it/s]
Loading 0:  11%|█         | 109/995 [00:03<00:49, 17.95it/s]
Loading 0:  11%|█▏        | 114/995 [00:04<00:42, 20.57it/s]
Loading 0:  12%|█▏        | 120/995 [00:04<00:35, 24.62it/s]
Loading 0:  13%|█▎        | 133/995 [00:04<00:23, 36.68it/s]
Loading 0:  14%|█▍        | 140/995 [00:04<00:20, 41.17it/s]
Loading 0:  15%|█▍        | 147/995 [00:04<00:18, 45.06it/s]
Loading 0:  15%|█▌        | 154/995 [00:04<00:18, 45.68it/s]
Loading 0:  16%|█▋        | 162/995 [00:05<00:45, 18.13it/s]
Loading 0:  17%|█▋        | 167/995 [00:05<00:39, 20.79it/s]
Loading 0:  17%|█▋        | 173/995 [00:05<00:33, 24.73it/s]
Loading 0:  18%|█▊        | 179/995 [00:06<00:27, 29.50it/s]
Loading 0:  19%|█▊        | 185/995 [00:06<00:23, 34.35it/s]
Loading 0:  20%|█▉        | 198/995 [00:06<00:16, 48.40it/s]
Loading 0:  21%|██        | 205/995 [00:06<00:15, 50.59it/s]
Loading 0:  21%|██▏       | 212/995 [00:07<00:44, 17.46it/s]
Loading 0:  22%|██▏       | 217/995 [00:07<00:38, 20.35it/s]
Loading 0:  23%|██▎       | 226/995 [00:07<00:27, 28.15it/s]
Loading 0:  23%|██▎       | 232/995 [00:07<00:23, 32.03it/s]
Loading 0:  24%|██▍       | 238/995 [00:07<00:22, 34.34it/s]
Loading 0:  25%|██▍       | 244/995 [00:08<00:20, 37.30it/s]
Loading 0:  25%|██▌       | 253/995 [00:08<00:15, 47.28it/s]
Loading 0:  26%|██▌       | 260/995 [00:08<00:14, 49.46it/s]
Loading 0:  27%|██▋       | 267/995 [00:09<00:44, 16.46it/s]
Loading 0:  28%|██▊       | 274/995 [00:09<00:33, 21.28it/s]
Loading 0:  28%|██▊       | 277/995 [00:23<00:33, 21.28it/s]
Loading 0:  28%|██▊       | 278/995 [00:23<08:49,  1.35it/s]
Loading 0:  29%|██▉       | 291/995 [00:24<04:36,  2.55it/s]
Loading 0:  30%|███       | 300/995 [00:24<03:09,  3.67it/s]
Loading 0:  31%|███       | 307/995 [00:24<02:20,  4.89it/s]
Loading 0:  32%|███▏      | 315/995 [00:24<01:40,  6.80it/s]
Loading 0:  32%|███▏      | 322/995 [00:25<01:39,  6.75it/s]
Loading 0:  33%|███▎      | 328/995 [00:25<01:16,  8.68it/s]
Loading 0:  34%|███▎      | 335/995 [00:25<00:56, 11.69it/s]
Loading 0:  34%|███▍      | 341/995 [00:25<00:44, 14.80it/s]
Loading 0:  35%|███▌      | 353/995 [00:25<00:27, 23.00it/s]
Loading 0:  36%|███▋      | 362/995 [00:25<00:21, 28.86it/s]
Loading 0:  37%|███▋      | 369/995 [00:27<00:41, 14.98it/s]
Loading 0:  38%|███▊      | 376/995 [00:27<00:32, 18.96it/s]
Loading 0:  39%|███▊      | 385/995 [00:27<00:23, 25.66it/s]
Loading 0:  39%|███▉      | 392/995 [00:27<00:19, 30.93it/s]
Loading 0:  40%|████      | 399/995 [00:27<00:17, 34.57it/s]
Loading 0:  41%|████      | 407/995 [00:27<00:14, 41.17it/s]
Loading 0:  42%|████▏     | 415/995 [00:27<00:12, 47.08it/s]
Loading 0:  42%|████▏     | 422/995 [00:27<00:11, 51.63it/s]
Loading 0:  43%|████▎     | 429/995 [00:29<00:33, 16.83it/s]
Loading 0:  44%|████▎     | 434/995 [00:29<00:28, 19.56it/s]
Loading 0:  45%|████▍     | 446/995 [00:29<00:18, 29.32it/s]
Loading 0:  46%|████▌     | 455/995 [00:29<00:15, 35.41it/s]
Loading 0:  46%|████▋     | 462/995 [00:29<00:13, 40.64it/s]
Loading 0:  47%|████▋     | 469/995 [00:29<00:11, 45.74it/s]
Loading 0:  48%|████▊     | 477/995 [00:29<00:09, 52.05it/s]
Loading 0:  49%|████▊     | 484/995 [00:30<00:29, 17.30it/s]
Loading 0:  49%|████▉     | 489/995 [00:30<00:25, 20.21it/s]
Loading 0:  50%|████▉     | 495/995 [00:31<00:20, 24.22it/s]
Loading 0:  51%|█████     | 505/995 [00:31<00:14, 33.71it/s]
Loading 0:  51%|█████▏    | 512/995 [00:31<00:12, 39.50it/s]
Loading 0:  52%|█████▏    | 519/995 [00:31<00:10, 44.80it/s]
Loading 0:  53%|█████▎    | 526/995 [00:32<00:32, 14.60it/s]
Loading 0:  54%|█████▍    | 536/995 [00:32<00:22, 20.74it/s]
Loading 0:  54%|█████▍    | 542/995 [00:32<00:18, 24.16it/s]
Loading 0:  55%|█████▌    | 548/995 [00:32<00:15, 28.04it/s]
Loading 0:  56%|█████▌    | 554/995 [00:33<00:14, 31.26it/s]
Loading 0:  56%|█████▋    | 562/995 [00:33<00:11, 38.61it/s]
Loading 0:  56%|█████▋    | 562/995 [00:43<00:11, 38.61it/s]
Loading 0:  57%|█████▋    | 563/995 [00:47<06:03,  1.19it/s]
Loading 0:  57%|█████▋    | 570/995 [00:47<03:51,  1.84it/s]
Loading 0:  58%|█████▊    | 579/995 [00:47<02:18,  3.00it/s]
Loading 0:  59%|█████▉    | 585/995 [00:49<02:00,  3.40it/s]
Loading 0:  60%|██████    | 598/995 [00:49<01:04,  6.11it/s]
Loading 0:  61%|██████    | 605/995 [00:49<00:48,  8.02it/s]
Loading 0:  62%|██████▏   | 612/995 [00:49<00:36, 10.50it/s]
Loading 0:  62%|██████▏   | 619/995 [00:49<00:28, 13.29it/s]
Loading 0:  63%|██████▎   | 631/995 [00:49<00:17, 20.81it/s]
Loading 0:  64%|██████▍   | 639/995 [00:50<00:27, 13.11it/s]
Loading 0:  65%|██████▍   | 645/995 [00:50<00:21, 15.97it/s]
Loading 0:  66%|██████▌   | 655/995 [00:51<00:15, 21.94it/s]
Loading 0:  67%|██████▋   | 663/995 [00:51<00:12, 27.60it/s]
Loading 0:  67%|██████▋   | 670/995 [00:51<00:10, 31.68it/s]
Loading 0:  68%|██████▊   | 677/995 [00:51<00:08, 36.91it/s]
Loading 0:  69%|██████▉   | 686/995 [00:51<00:07, 42.89it/s]
Loading 0:  70%|██████▉   | 693/995 [00:52<00:17, 17.50it/s]
Loading 0:  70%|███████   | 698/995 [00:52<00:14, 19.85it/s]
Loading 0:  71%|███████   | 706/995 [00:52<00:11, 25.26it/s]
Loading 0:  72%|███████▏  | 712/995 [00:53<00:09, 28.98it/s]
Loading 0:  73%|███████▎  | 722/995 [00:53<00:07, 38.98it/s]
Loading 0:  73%|███████▎  | 728/995 [00:53<00:06, 39.64it/s]
Loading 0:  74%|███████▍  | 734/995 [00:53<00:06, 41.77it/s]
Loading 0:  74%|███████▍  | 740/995 [00:54<00:17, 14.73it/s]
Loading 0:  76%|███████▌  | 753/995 [00:54<00:10, 23.91it/s]
Loading 0:  76%|███████▋  | 760/995 [00:54<00:08, 28.81it/s]
Loading 0:  77%|███████▋  | 766/995 [00:54<00:06, 32.77it/s]
Loading 0:  78%|███████▊  | 772/995 [00:54<00:06, 36.09it/s]
Loading 0:  79%|███████▉  | 784/995 [00:55<00:04, 47.89it/s]
Loading 0:  79%|███████▉  | 791/995 [00:55<00:03, 51.98it/s]
Loading 0:  80%|████████  | 798/995 [00:56<00:11, 17.71it/s]
Loading 0:  81%|████████  | 803/995 [00:56<00:09, 20.45it/s]
Loading 0:  81%|████████▏ | 810/995 [00:56<00:07, 25.49it/s]
Loading 0:  82%|████████▏ | 819/995 [00:56<00:05, 34.15it/s]
Loading 0:  83%|████████▎ | 826/995 [00:56<00:04, 39.58it/s]
Loading 0:  84%|████████▎ | 833/995 [00:56<00:03, 40.54it/s]
Loading 0:  85%|████████▌ | 846/995 [01:11<01:14,  2.00it/s]
Loading 0:  85%|████████▌ | 849/995 [01:12<01:10,  2.08it/s]
Loading 0:  86%|████████▌ | 858/995 [01:12<00:43,  3.13it/s]
Loading 0:  87%|████████▋ | 864/995 [01:12<00:31,  4.10it/s]
Loading 0:  88%|████████▊ | 872/995 [01:12<00:20,  5.90it/s]
Loading 0:  89%|████████▊ | 883/995 [01:13<00:12,  9.19it/s]
Loading 0:  89%|████████▉ | 890/995 [01:13<00:08, 11.87it/s]
Loading 0:  90%|█████████ | 897/995 [01:14<00:10,  9.64it/s]
Loading 0:  91%|█████████ | 903/995 [01:14<00:07, 11.97it/s]
Loading 0:  92%|█████████▏| 911/995 [01:14<00:05, 16.11it/s]
Loading 0:  92%|█████████▏| 917/995 [01:14<00:03, 19.56it/s]
Loading 0:  93%|█████████▎| 923/995 [01:14<00:03, 23.64it/s]
Loading 0:  93%|█████████▎| 929/995 [01:14<00:02, 28.12it/s]
Loading 0:  95%|█████████▍| 942/995 [01:14<00:01, 41.59it/s]
Loading 0:  95%|█████████▌| 949/995 [01:15<00:01, 45.58it/s]
Loading 0:  96%|█████████▌| 956/995 [01:16<00:02, 18.68it/s]
Loading 0:  97%|█████████▋| 963/995 [01:16<00:01, 23.47it/s]
Loading 0:  97%|█████████▋| 970/995 [01:16<00:00, 28.93it/s]
Loading 0:  98%|█████████▊| 976/995 [01:16<00:00, 33.39it/s]
Loading 0:  99%|█████████▉| 983/995 [01:16<00:00, 39.54it/s]
Loading 0: 100%|█████████▉| 991/995 [01:16<00:00, 43.68it/s]
                                                            
Job neversleep-noromaid-v0-8068-v151-mkmlizer completed after 310.75s with status: succeeded
Stopping job with name neversleep-noromaid-v0-8068-v151-mkmlizer
Pipeline stage MKMLizer completed in 311.85s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.28s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service neversleep-noromaid-v0-8068-v151
Waiting for inference service neversleep-noromaid-v0-8068-v151 to be ready
Inference service neversleep-noromaid-v0-8068-v151 ready after 203.0026297569275s
Pipeline stage MKMLDeployer completed in 203.98s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.320129156112671s
Received healthy response to inference request in 3.372159004211426s
Received healthy response to inference request in 3.282473087310791s
Received healthy response to inference request in 4.0748937129974365s
Received healthy response to inference request in 3.0243101119995117s
5 requests
0 failed requests
5th percentile: 3.0759427070617678
10th percentile: 3.1275753021240233
20th percentile: 3.230840492248535
30th percentile: 3.290004301071167
40th percentile: 3.305066728591919
50th percentile: 3.320129156112671
60th percentile: 3.3409410953521728
70th percentile: 3.3617530345916746
80th percentile: 3.5127059459686283
90th percentile: 3.7937998294830324
95th percentile: 3.934346771240234
99th percentile: 4.046784324645996
mean time: 3.414793014526367
Pipeline stage StressChecker completed in 19.47s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 3.78s
neversleep-noromaid-v0_8068_v151 status is now deployed due to DeploymentManager action
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.13s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service neversleep-noromaid-v0-8068-v151-profiler
Waiting for inference service neversleep-noromaid-v0-8068-v151-profiler to be ready
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLProfilerTemplater completed in 0.07s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service neversleep-noromaid-v0-8068-v151-profiler
Ignoring service neversleep-noromaid-v0-8068-v151-profiler already deployed
Waiting for inference service neversleep-noromaid-v0-8068-v151-profiler to be ready
neversleep-noromaid-v0_8068_v151 status is now inactive due to auto deactivation removed underperforming models
neversleep-noromaid-v0_8068_v151 status is now torndown due to DeploymentManager action