submission_id: zonemercy-gemini-edit-v1-1e5_v1
developer_uid: zonemercy
alignment_samples: 11043
alignment_score: 3.1692284541473215
best_of: 8
celo_rating: 1243.8
display_name: 0821v1-4
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
language_model: zonemercy/Gemini-Edit-v1-1e5
max_input_tokens: 1024
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: zonemercy/Gemini-Edit-v1
model_name: 0821v1-4
model_num_parameters: 12772070400.0
model_repo: zonemercy/Gemini-Edit-v1-1e5
model_size: 13B
num_battles: 11043
num_wins: 5532
propriety_score: 0.7338129496402878
propriety_total_count: 973.0
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-21T21:04:30+00:00
us_pacific_date: 2024-08-21
win_ratio: 0.5009508285791905
Download Preference Data
Resubmit model
Running pipeline stage MKMLizer
Starting job with name zonemercy-gemini-edit-v1-1e5-v1-mkmlizer
Waiting for job on zonemercy-gemini-edit-v1-1e5-v1-mkmlizer to finish
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║     _____            __           __                                ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║       /___/                                                         ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║                                                                     ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║                                                                     ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║  belonging to:                                                      ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║                                                                     ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ║                                                                     ║
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: Downloaded to shared memory in 117.637s
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpfyf8lap0, device:0
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: quantized model in 41.616s
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: Processed model zonemercy/Gemini-Edit-v1-1e5 in 159.254s
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1e5-v1
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1e5-v1/config.json
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1e5-v1/special_tokens_map.json
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1e5-v1/tokenizer_config.json
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1e5-v1/tokenizer.json
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1e5-v1/flywheel_model.0.safetensors
zonemercy-gemini-edit-v1-1e5-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:16, 21.93it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:12, 27.93it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:14, 23.80it/s]
Loading 0:   6%|▌         | 20/363 [00:00<00:10, 32.39it/s]
Loading 0:   7%|▋         | 24/363 [00:01<00:15, 21.27it/s]
Loading 0:   7%|▋         | 27/363 [00:01<00:16, 20.51it/s]
Loading 0:   9%|▊         | 31/363 [00:01<00:13, 23.74it/s]
Loading 0:   9%|▉         | 34/363 [00:01<00:13, 24.06it/s]
Loading 0:  11%|█         | 39/363 [00:01<00:12, 26.74it/s]
Loading 0:  12%|█▏        | 42/363 [00:01<00:13, 24.46it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:10, 29.04it/s]
Loading 0:  14%|█▍        | 52/363 [00:02<00:11, 27.41it/s]
Loading 0:  15%|█▌        | 56/363 [00:02<00:11, 27.57it/s]
Loading 0:  17%|█▋        | 60/363 [00:02<00:09, 30.30it/s]
Loading 0:  18%|█▊        | 64/363 [00:02<00:15, 19.26it/s]
Loading 0:  20%|█▉        | 71/363 [00:02<00:11, 26.05it/s]
Loading 0:  21%|██        | 75/363 [00:02<00:11, 25.28it/s]
Loading 0:  21%|██▏       | 78/363 [00:03<00:11, 24.02it/s]
Loading 0:  23%|██▎       | 84/363 [00:03<00:09, 28.51it/s]
Loading 0:  24%|██▍       | 88/363 [00:03<00:09, 27.63it/s]
Loading 0:  26%|██▌       | 93/363 [00:03<00:08, 30.10it/s]
Loading 0:  27%|██▋       | 97/363 [00:03<00:09, 28.78it/s]
Loading 0:  28%|██▊       | 101/363 [00:03<00:11, 23.33it/s]
Loading 0:  29%|██▊       | 104/363 [00:04<00:12, 20.42it/s]
Loading 0:  31%|███       | 111/363 [00:04<00:09, 27.28it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:09, 26.66it/s]
Loading 0:  33%|███▎      | 120/363 [00:04<00:08, 29.35it/s]
Loading 0:  34%|███▍      | 124/363 [00:04<00:08, 27.77it/s]
Loading 0:  36%|███▌      | 129/363 [00:04<00:08, 29.02it/s]
Loading 0:  37%|███▋      | 133/363 [00:05<00:08, 27.70it/s]
Loading 0:  38%|███▊      | 137/363 [00:05<00:08, 28.12it/s]
Loading 0:  39%|███▉      | 142/363 [00:05<00:09, 24.49it/s]
Loading 0:  40%|███▉      | 145/363 [00:05<00:09, 23.28it/s]
Loading 0:  41%|████      | 149/363 [00:05<00:09, 22.11it/s]
Loading 0:  43%|████▎     | 156/363 [00:06<00:07, 28.68it/s]
Loading 0:  44%|████▍     | 160/363 [00:06<00:07, 27.39it/s]
Loading 0:  45%|████▌     | 165/363 [00:06<00:06, 29.26it/s]
Loading 0:  47%|████▋     | 169/363 [00:06<00:06, 28.17it/s]
Loading 0:  48%|████▊     | 174/363 [00:06<00:06, 30.09it/s]
Loading 0:  49%|████▉     | 178/363 [00:06<00:06, 28.47it/s]
Loading 0:  50%|█████     | 182/363 [00:07<00:07, 23.67it/s]
Loading 0:  51%|█████     | 185/363 [00:07<00:08, 20.80it/s]
Loading 0:  53%|█████▎    | 192/363 [00:07<00:06, 27.60it/s]
Loading 0:  54%|█████▎    | 195/363 [00:07<00:06, 25.62it/s]
Loading 0:  55%|█████▌    | 201/363 [00:07<00:05, 29.83it/s]
Loading 0:  56%|█████▋    | 205/363 [00:07<00:05, 28.02it/s]
Loading 0:  58%|█████▊    | 210/363 [00:07<00:05, 29.61it/s]
Loading 0:  59%|█████▉    | 214/363 [00:08<00:05, 27.36it/s]
Loading 0:  60%|██████    | 218/363 [00:08<00:05, 27.66it/s]
Loading 0:  61%|██████▏   | 223/363 [00:08<00:05, 24.60it/s]
Loading 0:  62%|██████▏   | 226/363 [00:08<00:05, 23.03it/s]
Loading 0:  63%|██████▎   | 230/363 [00:08<00:06, 21.82it/s]
Loading 0:  65%|██████▌   | 236/363 [00:09<00:04, 28.97it/s]
Loading 0:  66%|██████▌   | 240/363 [00:09<00:04, 24.88it/s]
Loading 0:  67%|██████▋   | 244/363 [00:09<00:04, 27.68it/s]
Loading 0:  68%|██████▊   | 248/363 [00:09<00:04, 24.49it/s]
Loading 0:  70%|██████▉   | 254/363 [00:09<00:03, 31.56it/s]
Loading 0:  71%|███████   | 258/363 [00:09<00:03, 26.95it/s]
Loading 0:  72%|███████▏  | 263/363 [00:10<00:04, 23.41it/s]
Loading 0:  73%|███████▎  | 266/363 [00:10<00:04, 21.11it/s]
Loading 0:  75%|███████▌  | 273/363 [00:10<00:03, 27.51it/s]
Loading 0:  76%|███████▋  | 277/363 [00:10<00:03, 27.29it/s]
Loading 0:  78%|███████▊  | 282/363 [00:10<00:02, 30.16it/s]
Loading 0:  79%|███████▉  | 286/363 [00:10<00:02, 29.27it/s]
Loading 0:  80%|████████  | 291/363 [00:11<00:02, 32.16it/s]
Loading 0:  81%|████████▏ | 295/363 [00:11<00:02, 30.21it/s]
Loading 0:  82%|████████▏ | 299/363 [00:11<00:02, 28.99it/s]
Loading 0:  84%|████████▎ | 304/363 [00:11<00:02, 25.57it/s]
Loading 0:  85%|████████▍ | 307/363 [00:11<00:02, 23.58it/s]
Loading 0:  86%|████████▌ | 311/363 [00:11<00:02, 22.49it/s]
Loading 0:  88%|████████▊ | 318/363 [00:12<00:01, 29.47it/s]
Loading 0:  89%|████████▊ | 322/363 [00:12<00:01, 29.12it/s]
Loading 0:  90%|█████████ | 327/363 [00:12<00:01, 31.46it/s]
Loading 0:  91%|█████████ | 331/363 [00:12<00:01, 29.76it/s]
Loading 0:  93%|█████████▎| 336/363 [00:12<00:00, 32.33it/s]
Loading 0:  94%|█████████▎| 340/363 [00:12<00:00, 30.25it/s]
Loading 0:  95%|█████████▍| 344/363 [00:19<00:09,  1.99it/s]
Loading 0:  96%|█████████▌| 348/363 [00:19<00:05,  2.67it/s]
Loading 0:  97%|█████████▋| 353/363 [00:20<00:02,  3.89it/s]
Loading 0:  98%|█████████▊| 357/363 [00:20<00:01,  5.02it/s]
                                                            

Job zonemercy-gemini-edit-v1-1e5-v1-mkmlizer completed after 188.46s with status: succeeded
Stopping job with name zonemercy-gemini-edit-v1-1e5-v1-mkmlizer
Pipeline stage MKMLizer completed in 189.37s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-gemini-edit-v1-1e5-v1
Waiting for inference service zonemercy-gemini-edit-v1-1e5-v1 to be ready
Inference service zonemercy-gemini-edit-v1-1e5-v1 ready after 262.96490359306335s
Pipeline stage ISVCDeployer completed in 263.69s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8667869567871094s
Received healthy response to inference request in 2.070286750793457s
Received healthy response to inference request in 1.9459683895111084s
Received healthy response to inference request in 1.3810737133026123s
Received healthy response to inference request in 1.4490711688995361s
5 requests
0 failed requests
5th percentile: 1.3946732044219972
10th percentile: 1.4082726955413818
20th percentile: 1.4354716777801513
30th percentile: 1.5326143264770509
40th percentile: 1.6997006416320801
50th percentile: 1.8667869567871094
60th percentile: 1.898459529876709
70th percentile: 1.9301321029663085
80th percentile: 1.970832061767578
90th percentile: 2.0205594062805177
95th percentile: 2.045423078536987
99th percentile: 2.065314016342163
mean time: 1.7426373958587646
Pipeline stage StressChecker completed in 9.42s
zonemercy-gemini-edit-v1-1e5_v1 status is now deployed due to DeploymentManager action
zonemercy-gemini-edit-v1-1e5_v1 status is now inactive due to auto deactivation removed underperforming models
zonemercy-gemini-edit-v1-1e5_v1 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics