zonemercy-viral-ss-v0-1e5ep2

submission_id: zonemercy-viral-ss-v0-1e5ep2_v35
developer_uid: chai_backend_admin
best_of: 4
celo_rating: 1247.93
display_name: tempv1-0
family_friendly_score: 0.5587844400143127
family_friendly_standard_error: 0.006128893008648285
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
language_model: zonemercy/Viral-ss-v0-1e5ep2
max_input_tokens: 1024
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: zonemercy/Viral-ss-v0-1e
model_name: tempv1-0
model_num_parameters: 22247282688.0
model_repo: zonemercy/Viral-ss-v0-1e5ep2
model_size: 22B
num_battles: 6754
num_wins: 3352
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-10-11T21:43:52+00:00
us_pacific_date: 2024-10-11
win_ratio: 0.4962984897838318
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer
Waiting for job on zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer to finish
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: Downloaded to shared memory in 116.694s
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpturyhw5g, device:0
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: quantized model in 56.882s
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: Processed model zonemercy/Viral-ss-v0-1e5ep2 in 173.576s
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v35
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v35/config.json
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v35/special_tokens_map.json
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v35/tokenizer_config.json
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v35/tokenizer.json
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v35/flywheel_model.1.safetensors
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v35/flywheel_model.0.safetensors
zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer: 
Loading 0:   0%|          | 0/507 [00:00<?, ?it/s]
Loading 0:   1%|          | 4/507 [00:00<00:18, 27.39it/s]
Loading 0:   1%|▏         | 7/507 [00:00<00:24, 20.69it/s]
Loading 0:   2%|▏         | 10/507 [00:00<00:22, 21.98it/s]
Loading 0:   3%|▎         | 13/507 [00:00<00:23, 21.29it/s]
Loading 0:   3%|▎         | 16/507 [00:00<00:23, 20.54it/s]
Loading 0:   4%|▎         | 19/507 [00:00<00:22, 21.51it/s]
Loading 0:   4%|▍         | 22/507 [00:00<00:20, 23.44it/s]
Loading 0:   5%|▍         | 25/507 [00:01<00:29, 16.23it/s]
Loading 0:   5%|▌         | 27/507 [00:01<00:34, 14.05it/s]
Loading 0:   6%|▌         | 31/507 [00:01<00:26, 17.76it/s]
Loading 0:   7%|▋         | 34/507 [00:01<00:26, 17.97it/s]
Loading 0:   7%|▋         | 37/507 [00:01<00:24, 19.03it/s]
Loading 0:   8%|▊         | 40/507 [00:02<00:23, 19.64it/s]
Loading 0:   8%|▊         | 43/507 [00:02<00:23, 19.63it/s]
Loading 0:   9%|▉         | 46/507 [00:02<00:22, 20.64it/s]
Loading 0:  10%|▉         | 49/507 [00:02<00:20, 22.46it/s]
Loading 0:  10%|█         | 52/507 [00:02<00:27, 16.28it/s]
Loading 0:  11%|█         | 54/507 [00:02<00:32, 13.96it/s]
Loading 0:  11%|█▏        | 58/507 [00:03<00:25, 17.60it/s]
Loading 0:  12%|█▏        | 61/507 [00:03<00:24, 18.14it/s]
Loading 0:  13%|█▎        | 64/507 [00:03<00:22, 19.64it/s]
Loading 0:  13%|█▎        | 67/507 [00:03<00:21, 20.37it/s]
Loading 0:  14%|█▍        | 70/507 [00:03<00:21, 20.29it/s]
Loading 0:  14%|█▍        | 73/507 [00:03<00:20, 21.38it/s]
Loading 0:  15%|█▌        | 77/507 [00:03<00:17, 24.50it/s]
Loading 0:  16%|█▌        | 80/507 [00:04<00:25, 16.53it/s]
Loading 0:  16%|█▋        | 83/507 [00:04<00:26, 16.00it/s]
Loading 0:  17%|█▋        | 87/507 [00:04<00:22, 18.99it/s]
Loading 0:  18%|█▊        | 90/507 [00:04<00:19, 21.10it/s]
Loading 0:  18%|█▊        | 93/507 [00:04<00:18, 22.69it/s]
Loading 0:  19%|█▉        | 96/507 [00:05<00:21, 18.93it/s]
Loading 0:  20%|█▉        | 99/507 [00:05<00:20, 19.82it/s]
Loading 0:  20%|██        | 102/507 [00:05<00:20, 19.77it/s]
Loading 0:  21%|██        | 105/507 [00:05<00:19, 20.92it/s]
Loading 0:  21%|██▏       | 108/507 [00:05<00:28, 13.85it/s]
Loading 0:  22%|██▏       | 112/507 [00:05<00:23, 17.17it/s]
Loading 0:  23%|██▎       | 115/507 [00:06<00:22, 17.50it/s]
Loading 0:  23%|██▎       | 118/507 [00:06<00:20, 18.97it/s]
Loading 0:  24%|██▍       | 121/507 [00:06<00:19, 19.76it/s]
Loading 0:  24%|██▍       | 124/507 [00:06<00:19, 19.59it/s]
Loading 0:  25%|██▌       | 127/507 [00:06<00:18, 20.57it/s]
Loading 0:  26%|██▌       | 131/507 [00:06<00:15, 23.75it/s]
Loading 0:  26%|██▋       | 134/507 [00:07<00:22, 16.25it/s]
Loading 0:  27%|██▋       | 137/507 [00:07<00:21, 17.17it/s]
Loading 0:  28%|██▊       | 140/507 [00:07<00:25, 14.62it/s]
Loading 0:  29%|██▊       | 145/507 [00:07<00:18, 19.15it/s]
Loading 0:  29%|██▉       | 148/507 [00:07<00:18, 19.82it/s]
Loading 0:  30%|██▉       | 151/507 [00:07<00:17, 19.79it/s]
Loading 0:  30%|███       | 154/507 [00:08<00:17, 20.75it/s]
Loading 0:  31%|███       | 158/507 [00:08<00:14, 23.80it/s]
Loading 0:  32%|███▏      | 161/507 [00:08<00:20, 16.63it/s]
Loading 0:  32%|███▏      | 164/507 [00:08<00:19, 17.49it/s]
Loading 0:  33%|███▎      | 167/507 [00:08<00:22, 14.98it/s]
Loading 0:  34%|███▍      | 172/507 [00:09<00:17, 19.44it/s]
Loading 0:  35%|███▍      | 175/507 [00:09<00:16, 20.06it/s]
Loading 0:  35%|███▌      | 178/507 [00:09<00:16, 20.09it/s]
Loading 0:  36%|███▌      | 181/507 [00:09<00:15, 21.05it/s]
Loading 0:  36%|███▋      | 185/507 [00:09<00:13, 24.26it/s]
Loading 0:  37%|███▋      | 188/507 [00:09<00:19, 16.67it/s]
Loading 0:  38%|███▊      | 191/507 [00:10<00:17, 17.90it/s]
Loading 0:  38%|███▊      | 194/507 [00:10<00:21, 14.82it/s]
Loading 0:  39%|███▉      | 199/507 [00:10<00:15, 19.55it/s]
Loading 0:  40%|███▉      | 202/507 [00:10<00:15, 20.32it/s]
Loading 0:  40%|████      | 205/507 [00:10<00:14, 20.24it/s]
Loading 0:  41%|████      | 208/507 [00:10<00:13, 21.53it/s]
Loading 0:  42%|████▏     | 212/507 [00:11<00:11, 24.64it/s]
Loading 0:  42%|████▏     | 215/507 [00:11<00:17, 16.82it/s]
Loading 0:  43%|████▎     | 218/507 [00:11<00:16, 17.84it/s]
Loading 0:  44%|████▎     | 221/507 [00:11<00:19, 15.04it/s]
Loading 0:  45%|████▍     | 226/507 [00:11<00:14, 19.53it/s]
Loading 0:  45%|████▌     | 229/507 [00:12<00:13, 20.21it/s]
Loading 0:  46%|████▌     | 232/507 [00:12<00:13, 20.09it/s]
Loading 0:  46%|████▋     | 235/507 [00:12<00:12, 21.04it/s]
Loading 0:  47%|████▋     | 239/507 [00:12<00:11, 24.23it/s]
Loading 0:  48%|████▊     | 242/507 [00:12<00:15, 16.84it/s]
Loading 0:  48%|████▊     | 245/507 [00:12<00:14, 17.90it/s]
Loading 0:  49%|████▉     | 248/507 [00:13<00:17, 15.18it/s]
Loading 0:  50%|████▉     | 253/507 [00:13<00:12, 19.84it/s]
Loading 0:  50%|█████     | 256/507 [00:13<00:12, 20.54it/s]
Loading 0:  51%|█████     | 259/507 [00:13<00:12, 20.38it/s]
Loading 0:  52%|█████▏    | 262/507 [00:13<00:11, 21.44it/s]
Loading 0:  52%|█████▏    | 266/507 [00:13<00:09, 24.35it/s]
Loading 0:  53%|█████▎    | 269/507 [00:14<00:13, 17.37it/s]
Loading 0:  54%|█████▎    | 272/507 [00:14<00:12, 18.38it/s]
Loading 0:  54%|█████▍    | 275/507 [00:14<00:15, 15.39it/s]
Loading 0:  55%|█████▌    | 280/507 [00:14<00:11, 20.23it/s]
Loading 0:  56%|█████▌    | 283/507 [00:14<00:10, 20.44it/s]
Loading 0:  56%|█████▋    | 286/507 [00:15<00:11, 20.08it/s]
Loading 0:  57%|█████▋    | 289/507 [00:15<00:10, 21.30it/s]
Loading 0:  58%|█████▊    | 293/507 [00:15<00:08, 24.45it/s]
Loading 0:  58%|█████▊    | 296/507 [00:15<00:12, 17.13it/s]
Loading 0:  59%|█████▉    | 299/507 [00:15<00:11, 18.37it/s]
Loading 0:  59%|█████▉    | 299/507 [00:31<00:11, 18.37it/s]
Loading 0:  59%|█████▉    | 300/507 [00:31<06:24,  1.86s/it]
Loading 0:  60%|█████▉    | 302/507 [00:31<04:51,  1.42s/it]
Loading 0:  60%|██████    | 306/507 [00:31<02:50,  1.18it/s]
Loading 0:  61%|██████    | 309/507 [00:31<01:59,  1.66it/s]
Loading 0:  61%|██████▏   | 311/507 [00:31<01:35,  2.05it/s]
Loading 0:  62%|██████▏   | 316/507 [00:32<00:53,  3.55it/s]
Loading 0:  63%|██████▎   | 320/507 [00:32<00:36,  5.09it/s]
Loading 0:  64%|██████▎   | 323/507 [00:32<00:31,  5.78it/s]
Loading 0:  64%|██████▍   | 326/507 [00:32<00:25,  7.21it/s]
Loading 0:  65%|██████▍   | 329/507 [00:32<00:22,  7.88it/s]
Loading 0:  66%|██████▌   | 334/507 [00:33<00:15, 11.36it/s]
Loading 0:  66%|██████▋   | 337/507 [00:33<00:13, 12.71it/s]
Loading 0:  67%|██████▋   | 340/507 [00:33<00:11, 13.98it/s]
Loading 0:  68%|██████▊   | 343/507 [00:33<00:10, 15.58it/s]
Loading 0:  68%|██████▊   | 346/507 [00:33<00:09, 17.61it/s]
Loading 0:  69%|██████▉   | 349/507 [00:33<00:11, 14.14it/s]
Loading 0:  69%|██████▉   | 351/507 [00:34<00:12, 12.85it/s]
Loading 0:  70%|███████   | 355/507 [00:34<00:09, 16.43it/s]
Loading 0:  71%|███████   | 358/507 [00:34<00:08, 17.06it/s]
Loading 0:  71%|███████   | 361/507 [00:34<00:07, 18.47it/s]
Loading 0:  72%|███████▏  | 364/507 [00:34<00:07, 18.93it/s]
Loading 0:  72%|███████▏  | 367/507 [00:34<00:07, 19.10it/s]
Loading 0:  73%|███████▎  | 370/507 [00:35<00:06, 20.23it/s]
Loading 0:  74%|███████▎  | 373/507 [00:35<00:06, 21.91it/s]
Loading 0:  74%|███████▍  | 376/507 [00:35<00:08, 15.95it/s]
Loading 0:  75%|███████▍  | 378/507 [00:35<00:09, 13.96it/s]
Loading 0:  75%|███████▌  | 382/507 [00:35<00:07, 17.83it/s]
Loading 0:  76%|███████▌  | 385/507 [00:35<00:06, 18.37it/s]
Loading 0:  77%|███████▋  | 388/507 [00:36<00:06, 19.79it/s]
Loading 0:  77%|███████▋  | 391/507 [00:36<00:05, 20.15it/s]
Loading 0:  78%|███████▊  | 394/507 [00:36<00:05, 19.99it/s]
Loading 0:  78%|███████▊  | 397/507 [00:36<00:05, 21.58it/s]
Loading 0:  79%|███████▉  | 400/507 [00:36<00:04, 22.93it/s]
Loading 0:  79%|███████▉  | 403/507 [00:36<00:06, 16.95it/s]
Loading 0:  80%|███████▉  | 405/507 [00:37<00:07, 14.55it/s]
Loading 0:  81%|████████  | 409/507 [00:37<00:05, 17.94it/s]
Loading 0:  81%|████████▏ | 412/507 [00:37<00:05, 18.20it/s]
Loading 0:  82%|████████▏ | 415/507 [00:37<00:04, 19.70it/s]
Loading 0:  82%|████████▏ | 418/507 [00:37<00:04, 20.06it/s]
Loading 0:  83%|████████▎ | 421/507 [00:37<00:04, 20.09it/s]
Loading 0:  84%|████████▎ | 424/507 [00:37<00:03, 21.35it/s]
Loading 0:  84%|████████▍ | 427/507 [00:38<00:03, 22.69it/s]
Loading 0:  85%|████████▍ | 430/507 [00:38<00:04, 16.51it/s]
Loading 0:  85%|████████▌ | 432/507 [00:38<00:05, 14.51it/s]
Loading 0:  86%|████████▌ | 436/507 [00:38<00:03, 18.19it/s]
Loading 0:  87%|████████▋ | 439/507 [00:38<00:03, 18.80it/s]
Loading 0:  87%|████████▋ | 442/507 [00:38<00:03, 20.50it/s]
Loading 0:  88%|████████▊ | 445/507 [00:39<00:02, 21.38it/s]
Loading 0:  88%|████████▊ | 448/507 [00:39<00:02, 21.10it/s]
Loading 0:  89%|████████▉ | 451/507 [00:39<00:02, 22.16it/s]
Loading 0:  90%|████████▉ | 455/507 [00:39<00:02, 25.32it/s]
Loading 0:  90%|█████████ | 458/507 [00:39<00:02, 17.92it/s]
Loading 0:  91%|█████████ | 461/507 [00:39<00:02, 18.96it/s]
Loading 0:  92%|█████████▏| 464/507 [00:40<00:02, 15.86it/s]
Loading 0:  93%|█████████▎| 469/507 [00:40<00:01, 21.08it/s]
Loading 0:  93%|█████████▎| 472/507 [00:40<00:01, 21.81it/s]
Loading 0:  94%|█████████▎| 475/507 [00:40<00:01, 21.48it/s]
Loading 0:  94%|█████████▍| 478/507 [00:40<00:01, 22.89it/s]
Loading 0:  95%|█████████▌| 482/507 [00:40<00:00, 26.02it/s]
Loading 0:  96%|█████████▌| 485/507 [00:43<00:05,  4.16it/s]
Loading 0:  96%|█████████▌| 487/507 [00:43<00:04,  4.73it/s]
Loading 0:  97%|█████████▋| 491/507 [00:43<00:02,  6.92it/s]
Loading 0:  97%|█████████▋| 494/507 [00:43<00:01,  8.59it/s]
Loading 0:  98%|█████████▊| 497/507 [00:43<00:00, 10.62it/s]
Loading 0:  99%|█████████▊| 500/507 [00:43<00:00, 12.69it/s]
Loading 0:  99%|█████████▉| 503/507 [00:43<00:00, 14.65it/s]
Loading 0: 100%|█████████▉| 506/507 [00:44<00:00, 17.19it/s]
                                                            
Job zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer completed after 205.34s with status: succeeded
Stopping job with name zonemercy-viral-ss-v0-1e5ep2-v35-mkmlizer
Pipeline stage MKMLizer completed in 205.82s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-viral-ss-v0-1e5ep2-v35
Waiting for inference service zonemercy-viral-ss-v0-1e5ep2-v35 to be ready
Inference service zonemercy-viral-ss-v0-1e5ep2-v35 ready after 150.5448863506317s
Pipeline stage MKMLDeployer completed in 150.96s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.61372709274292s
Received healthy response to inference request in 2.6858158111572266s
Received healthy response to inference request in 2.774718761444092s
Retrying (%r) after connection broken by '%r': %s
Received healthy response to inference request in 2.951075553894043s
5 requests
1 failed requests
5th percentile: 2.7035964012145994
10th percentile: 2.7213769912719727
20th percentile: 2.756938171386719
30th percentile: 2.809990119934082
40th percentile: 2.8805328369140626
50th percentile: 2.951075553894043
60th percentile: 3.216136169433594
70th percentile: 3.4811967849731444
80th percentile: 6.921259355545047
90th percentile: 13.536323881149293
95th percentile: 16.843856143951413
99th percentile: 19.489881954193116
mean time: 6.435345125198364
%s, retrying in %s seconds...
Received healthy response to inference request in 2.662930727005005s
Received healthy response to inference request in 2.744889974594116s
Received healthy response to inference request in 2.885289192199707s
Received healthy response to inference request in 2.7342894077301025s
Received healthy response to inference request in 2.792095184326172s
5 requests
0 failed requests
5th percentile: 2.6772024631500244
10th percentile: 2.691474199295044
20th percentile: 2.720017671585083
30th percentile: 2.7364095211029054
40th percentile: 2.7406497478485106
50th percentile: 2.744889974594116
60th percentile: 2.7637720584869383
70th percentile: 2.782654142379761
80th percentile: 2.810733985900879
90th percentile: 2.848011589050293
95th percentile: 2.866650390625
99th percentile: 2.8815614318847658
mean time: 2.7638988971710203
Pipeline stage StressChecker completed in 49.68s
Shutdown handler de-registered
zonemercy-viral-ss-v0-1e5ep2_v35 status is now deployed due to DeploymentManager action
zonemercy-viral-ss-v0-1e5ep2_v35 status is now inactive due to auto deactivation removed underperforming models
zonemercy-viral-ss-v0-1e5ep2_v35 status is now torndown due to DeploymentManager action