zonemercy-viral-ss-v11-12b1e5

submission_id: zonemercy-viral-ss-v11-12b1e5_v3

developer_uid: chai_backend_admin

best_of: 8

celo_rating: 1270.66

display_name: tempv1-4

family_friendly_score: 0.5592497868712702

family_friendly_standard_error: 0.006249489352913788

formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

is_internal_developer: True

language_model: zonemercy/Viral-ss-v11-12b1e5

max_input_tokens: 1024

max_output_tokens: 64

model_architecture: MistralForCausalLM

model_group: zonemercy/Viral-ss-v11-1

model_name: tempv1-4

model_num_parameters: 12772070400.0

model_repo: zonemercy/Viral-ss-v11-12b1e5

model_size: 13B

num_battles: 6550

num_wins: 3375

ranking_group: single

status: torndown

submission_type: basic

timestamp: 2024-10-17T21:02:28+00:00

us_pacific_date: 2024-10-17

win_ratio: 0.5152671755725191

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer
Waiting for job on zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer to finish
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: Downloaded to shared memory in 37.191s
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp96hmmva5, device:0
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: quantized model in 37.742s
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: Processed model zonemercy/Viral-ss-v11-12b1e5 in 74.933s
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-viral-ss-v11-12b1e5-v3
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-viral-ss-v11-12b1e5-v3/config.json
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-viral-ss-v11-12b1e5-v3/special_tokens_map.json
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-viral-ss-v11-12b1e5-v3/tokenizer_config.json
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-viral-ss-v11-12b1e5-v3/tokenizer.json
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-viral-ss-v11-12b1e5-v3/flywheel_model.0.safetensors
zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:13, 26.84it/s]
Loading 0:   4%|▎         | 13/363 [00:00<00:07, 47.24it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:07, 46.06it/s]
Loading 0:   7%|▋         | 24/363 [00:00<00:07, 45.15it/s]
Loading 0:   9%|▊         | 31/363 [00:00<00:06, 51.35it/s]
Loading 0:  10%|█         | 37/363 [00:00<00:06, 47.32it/s]
Loading 0:  12%|█▏        | 42/363 [00:00<00:06, 45.95it/s]
Loading 0:  13%|█▎        | 49/363 [00:01<00:06, 50.65it/s]
Loading 0:  15%|█▌        | 55/363 [00:01<00:06, 47.74it/s]
Loading 0:  17%|█▋        | 61/363 [00:01<00:08, 34.64it/s]
Loading 0:  18%|█▊        | 66/363 [00:01<00:08, 34.64it/s]
Loading 0:  20%|█▉        | 71/363 [00:01<00:07, 37.79it/s]
Loading 0:  21%|██        | 76/363 [00:01<00:07, 39.54it/s]
Loading 0:  22%|██▏       | 81/363 [00:01<00:06, 41.29it/s]
Loading 0:  24%|██▍       | 87/363 [00:02<00:06, 40.50it/s]
Loading 0:  25%|██▌       | 92/363 [00:02<00:06, 39.47it/s]
Loading 0:  27%|██▋       | 98/363 [00:02<00:06, 43.65it/s]
Loading 0:  28%|██▊       | 103/363 [00:02<00:05, 43.39it/s]
Loading 0:  30%|██▉       | 108/363 [00:02<00:05, 44.10it/s]
Loading 0:  31%|███       | 113/363 [00:02<00:07, 33.54it/s]
Loading 0:  33%|███▎      | 118/363 [00:02<00:07, 33.79it/s]
Loading 0:  34%|███▍      | 125/363 [00:03<00:05, 40.47it/s]
Loading 0:  36%|███▌      | 130/363 [00:03<00:05, 39.27it/s]
Loading 0:  37%|███▋      | 135/363 [00:03<00:05, 40.32it/s]
Loading 0:  39%|███▊      | 140/363 [00:03<00:05, 41.60it/s]
Loading 0:  40%|███▉      | 145/363 [00:03<00:08, 25.51it/s]
Loading 0:  41%|████      | 149/363 [00:03<00:08, 25.47it/s]
Loading 0:  43%|████▎     | 156/363 [00:04<00:06, 32.23it/s]
Loading 0:  44%|████▍     | 160/363 [00:04<00:06, 31.75it/s]
Loading 0:  45%|████▌     | 165/363 [00:04<00:05, 34.78it/s]
Loading 0:  47%|████▋     | 169/363 [00:04<00:05, 33.27it/s]
Loading 0:  48%|████▊     | 174/363 [00:04<00:05, 36.06it/s]
Loading 0:  49%|████▉     | 178/363 [00:04<00:05, 34.58it/s]
Loading 0:  50%|█████     | 183/363 [00:04<00:04, 36.47it/s]
Loading 0:  52%|█████▏    | 187/363 [00:04<00:05, 35.18it/s]
Loading 0:  53%|█████▎    | 192/363 [00:05<00:04, 36.95it/s]
Loading 0:  54%|█████▍    | 196/363 [00:05<00:04, 34.98it/s]
Loading 0:  55%|█████▌    | 201/363 [00:05<00:04, 37.21it/s]
Loading 0:  56%|█████▋    | 205/363 [00:05<00:04, 35.19it/s]
Loading 0:  58%|█████▊    | 210/363 [00:05<00:04, 37.65it/s]
Loading 0:  59%|█████▉    | 214/363 [00:05<00:04, 35.65it/s]
Loading 0:  60%|██████    | 218/363 [00:05<00:04, 35.05it/s]
Loading 0:  61%|██████▏   | 223/363 [00:06<00:05, 25.98it/s]
Loading 0:  62%|██████▏   | 226/363 [00:06<00:05, 25.57it/s]
Loading 0:  63%|██████▎   | 230/363 [00:06<00:05, 25.64it/s]
Loading 0:  65%|██████▌   | 237/363 [00:06<00:03, 33.94it/s]
Loading 0:  66%|██████▋   | 241/363 [00:06<00:03, 33.37it/s]
Loading 0:  68%|██████▊   | 246/363 [00:06<00:03, 35.83it/s]
Loading 0:  69%|██████▉   | 250/363 [00:06<00:03, 34.48it/s]
Loading 0:  70%|███████   | 255/363 [00:06<00:02, 36.61it/s]
Loading 0:  71%|███████▏  | 259/363 [00:07<00:02, 35.19it/s]
Loading 0:  73%|███████▎  | 264/363 [00:07<00:02, 37.69it/s]
Loading 0:  74%|███████▍  | 268/363 [00:07<00:02, 35.22it/s]
Loading 0:  75%|███████▌  | 273/363 [00:07<00:02, 37.79it/s]
Loading 0:  76%|███████▋  | 277/363 [00:07<00:02, 35.96it/s]
Loading 0:  78%|███████▊  | 282/363 [00:07<00:02, 38.35it/s]
Loading 0:  79%|███████▉  | 286/363 [00:07<00:02, 35.82it/s]
Loading 0:  80%|████████  | 291/363 [00:07<00:01, 37.45it/s]
Loading 0:  81%|████████▏ | 295/363 [00:08<00:01, 35.40it/s]
Loading 0:  82%|████████▏ | 299/363 [00:08<00:01, 35.18it/s]
Loading 0:  84%|████████▎ | 304/363 [00:15<00:28,  2.09it/s]
Loading 0:  85%|████████▍ | 307/363 [00:15<00:21,  2.61it/s]
Loading 0:  86%|████████▌ | 312/363 [00:15<00:13,  3.85it/s]
Loading 0:  88%|████████▊ | 319/363 [00:15<00:07,  6.28it/s]
Loading 0:  89%|████████▉ | 324/363 [00:15<00:04,  8.33it/s]
Loading 0:  91%|█████████ | 329/363 [00:15<00:03, 10.87it/s]
Loading 0:  92%|█████████▏| 333/363 [00:15<00:02, 13.28it/s]
Loading 0:  93%|█████████▎| 337/363 [00:15<00:01, 15.92it/s]
Loading 0:  94%|█████████▍| 341/363 [00:16<00:01, 18.68it/s]
Loading 0:  96%|█████████▌| 347/363 [00:16<00:00, 24.30it/s]
Loading 0:  97%|█████████▋| 352/363 [00:16<00:00, 28.59it/s]
Loading 0:  98%|█████████▊| 357/363 [00:16<00:00, 28.90it/s]
                                                            
Job zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer completed after 102.62s with status: succeeded
Stopping job with name zonemercy-viral-ss-v11-12b1e5-v3-mkmlizer
Pipeline stage MKMLizer completed in 103.54s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-viral-ss-v11-12b1e5-v3
Waiting for inference service zonemercy-viral-ss-v11-12b1e5-v3 to be ready
Inference service zonemercy-viral-ss-v11-12b1e5-v3 ready after 170.97847533226013s
Pipeline stage MKMLDeployer completed in 171.49s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.009805202484131s
Received healthy response to inference request in 2.054480791091919s
Received healthy response to inference request in 1.5976288318634033s
Received healthy response to inference request in 1.7885050773620605s
Received healthy response to inference request in 1.7572038173675537s
5 requests
0 failed requests
5th percentile: 1.6295438289642334
10th percentile: 1.6614588260650636
20th percentile: 1.7252888202667236
30th percentile: 1.7634640693664552
40th percentile: 1.7759845733642579
50th percentile: 1.7885050773620605
60th percentile: 1.8770251274108887
70th percentile: 1.9655451774597168
80th percentile: 2.0187403202056884
90th percentile: 2.036610555648804
95th percentile: 2.0455456733703614
99th percentile: 2.0526937675476074
mean time: 1.8415247440338134
Pipeline stage StressChecker completed in 10.38s
Shutdown handler de-registered
zonemercy-viral-ss-v11-12b1e5_v3 status is now deployed due to DeploymentManager action
zonemercy-viral-ss-v11-12b1e5_v3 status is now inactive due to auto deactivation removed underperforming models
zonemercy-viral-ss-v11-12b1e5_v3 status is now torndown due to DeploymentManager action