zmeeks-capitanito-54-2800

developer_uid: zmeeks

submission_id: zmeeks-capitanito-54-2800_v2

model_name: capitanito_t10__z54-2800__ppmmp

model_group: zmeeks/capitanito__54-28

status: torndown

timestamp: 2025-07-18T00:40:55+00:00

num_battles: 6846

num_wins: 3289

celo_rating: 1260.78

family_friendly_score: 0.5920000000000001

family_friendly_standard_error: 0.006950338121271511

submission_type: basic

model_repo: zmeeks/capitanito__54-2800

model_architecture: MistralForCausalLM

model_num_parameters: 12772070400.0

best_of: 8

max_input_tokens: 2048

max_output_tokens: 64

reward_model: default

latencies: [{'batch_size': 1, 'throughput': 0.48297297294434116, 'latency_mean': 2.0703297531604767, 'latency_p50': 2.0608575344085693, 'latency_p90': 2.25208957195282}, {'batch_size': 2, 'throughput': 0.6709847130565518, 'latency_mean': 2.9792715191841124, 'latency_p50': 2.9830087423324585, 'latency_p90': 3.2373197793960573}, {'batch_size': 3, 'throughput': 0.7661007259955931, 'latency_mean': 3.8981599485874177, 'latency_p50': 3.9053674936294556, 'latency_p90': 4.257557678222656}, {'batch_size': 4, 'throughput': 0.8306473556249907, 'latency_mean': 4.798698216676712, 'latency_p50': 4.8044493198394775, 'latency_p90': 5.324780869483948}, {'batch_size': 5, 'throughput': 0.873244973655558, 'latency_mean': 5.710106241703033, 'latency_p50': 5.702481985092163, 'latency_p90': 6.556058478355408}]

gpu_counts: {'NVIDIA RTX A5000': 1}

display_name: capitanito_t10__z54-2800__ppmmp

is_internal_developer: False

language_model: zmeeks/capitanito__54-2800

model_size: 13B

ranking_group: single

throughput_3p7s: 0.75

us_pacific_date: 2025-07-17

win_ratio: 0.48042652643879635

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 25, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zmeeks-capitanito-54-2800-v2-mkmlizer
Waiting for job on zmeeks-capitanito-54-2800-v2-mkmlizer to finish
zmeeks-capitanito-54-2800-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zmeeks-capitanito-54-2800-v2-mkmlizer: ║                                                                     ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║                                                                     ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  Version: 0.29.15                                                   ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  https://mk1.ai                                                     ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║                                                                     ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  belonging to:                                                      ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║                                                                     ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  Chai Research Corp.                                                ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ║                                                                     ║
zmeeks-capitanito-54-2800-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zmeeks-capitanito-54-2800-v2-mkmlizer: Downloaded to shared memory in 40.719s
zmeeks-capitanito-54-2800-v2-mkmlizer: Checking if zmeeks/capitanito__54-2800 already exists in ChaiML
zmeeks-capitanito-54-2800-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmphmg_ayfy, device:0
zmeeks-capitanito-54-2800-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zmeeks-capitanito-54-2800-v2-mkmlizer: quantized model in 39.315s
zmeeks-capitanito-54-2800-v2-mkmlizer: Processed model zmeeks/capitanito__54-2800 in 80.116s
zmeeks-capitanito-54-2800-v2-mkmlizer: creating bucket guanaco-mkml-models
zmeeks-capitanito-54-2800-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zmeeks-capitanito-54-2800-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zmeeks-capitanito-54-2800-v2/nvidia
zmeeks-capitanito-54-2800-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zmeeks-capitanito-54-2800-v2/nvidia/config.json
zmeeks-capitanito-54-2800-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zmeeks-capitanito-54-2800-v2/nvidia/special_tokens_map.json
zmeeks-capitanito-54-2800-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zmeeks-capitanito-54-2800-v2/nvidia/tokenizer_config.json
zmeeks-capitanito-54-2800-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zmeeks-capitanito-54-2800-v2/nvidia/tokenizer.json
zmeeks-capitanito-54-2800-v2-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:14, 24.00it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:10, 33.94it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:12, 28.75it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:10, 34.06it/s]
Loading 0:   6%|▋         | 23/363 [00:00<00:11, 29.89it/s]
Loading 0:   8%|▊         | 28/363 [00:00<00:09, 34.63it/s]
Loading 0:   9%|▉         | 32/363 [00:01<00:10, 30.24it/s]
Loading 0:  10%|█         | 37/363 [00:01<00:09, 34.95it/s]
Loading 0:  11%|█▏        | 41/363 [00:01<00:10, 31.19it/s]
Loading 0:  13%|█▎        | 46/363 [00:01<00:09, 35.04it/s]
Loading 0:  14%|█▍        | 50/363 [00:01<00:09, 31.51it/s]
Loading 0:  15%|█▌        | 56/363 [00:01<00:08, 36.47it/s]
Loading 0:  17%|█▋        | 60/363 [00:01<00:08, 36.68it/s]
Loading 0:  18%|█▊        | 64/363 [00:02<00:15, 19.70it/s]
Loading 0:  19%|█▉        | 70/363 [00:02<00:11, 26.16it/s]
Loading 0:  20%|██        | 74/363 [00:02<00:11, 25.54it/s]
Loading 0:  21%|██▏       | 78/363 [00:02<00:10, 28.16it/s]
Loading 0:  23%|██▎       | 82/363 [00:02<00:10, 26.92it/s]
Loading 0:  24%|██▍       | 87/363 [00:02<00:08, 31.47it/s]
Loading 0:  25%|██▌       | 91/363 [00:03<00:09, 28.03it/s]
Loading 0:  26%|██▋       | 96/363 [00:03<00:08, 32.32it/s]
Loading 0:  28%|██▊       | 100/363 [00:03<00:09, 29.06it/s]
Loading 0:  29%|██▉       | 105/363 [00:03<00:07, 33.21it/s]
Loading 0:  30%|███       | 110/363 [00:03<00:07, 34.44it/s]
Loading 0:  31%|███▏      | 114/363 [00:03<00:07, 32.34it/s]
Loading 0:  33%|███▎      | 118/363 [00:03<00:08, 28.86it/s]
Loading 0:  34%|███▍      | 123/363 [00:04<00:07, 33.02it/s]
Loading 0:  35%|███▍      | 127/363 [00:04<00:08, 29.25it/s]
Loading 0:  36%|███▋      | 132/363 [00:04<00:06, 33.04it/s]
Loading 0:  37%|███▋      | 136/363 [00:04<00:07, 29.48it/s]
Loading 0:  39%|███▉      | 141/363 [00:04<00:06, 33.42it/s]
Loading 0:  40%|███▉      | 145/363 [00:05<00:11, 18.46it/s]
Loading 0:  41%|████      | 149/363 [00:05<00:11, 18.85it/s]
Loading 0:  42%|████▏     | 154/363 [00:05<00:09, 23.08it/s]
Loading 0:  44%|████▎     | 158/363 [00:05<00:09, 22.51it/s]
Loading 0:  45%|████▍     | 163/363 [00:05<00:07, 26.35it/s]
Loading 0:  46%|████▌     | 167/363 [00:05<00:07, 24.75it/s]
Loading 0:  47%|████▋     | 172/363 [00:06<00:06, 28.71it/s]
Loading 0:  48%|████▊     | 176/363 [00:06<00:07, 25.44it/s]
Loading 0:  50%|████▉     | 181/363 [00:06<00:06, 29.50it/s]
Loading 0:  51%|█████     | 185/363 [00:06<00:06, 26.47it/s]
Loading 0:  52%|█████▏    | 190/363 [00:06<00:05, 30.18it/s]
Loading 0:  53%|█████▎    | 194/363 [00:06<00:06, 26.88it/s]
Loading 0:  55%|█████▍    | 199/363 [00:06<00:05, 30.37it/s]
Loading 0:  56%|█████▌    | 203/363 [00:07<00:05, 27.04it/s]
Loading 0:  57%|█████▋    | 208/363 [00:07<00:04, 31.10it/s]
Loading 0:  58%|█████▊    | 212/363 [00:07<00:05, 27.38it/s]
Loading 0:  60%|█████▉    | 217/363 [00:07<00:04, 31.07it/s]
Loading 0:  61%|██████    | 222/363 [00:07<00:04, 31.74it/s]
Loading 0:  62%|██████▏   | 226/363 [00:08<00:07, 18.62it/s]
Loading 0:  63%|██████▎   | 230/363 [00:08<00:07, 18.74it/s]
Loading 0:  65%|██████▍   | 235/363 [00:08<00:05, 22.58it/s]
Loading 0:  66%|██████▌   | 239/363 [00:08<00:05, 21.77it/s]
Loading 0:  67%|██████▋   | 244/363 [00:08<00:04, 24.61it/s]
Loading 0:  68%|██████▊   | 248/363 [00:09<00:05, 22.98it/s]
Loading 0:  70%|██████▉   | 253/363 [00:09<00:04, 26.36it/s]
Loading 0:  71%|███████   | 257/363 [00:09<00:04, 24.31it/s]
Loading 0:  72%|███████▏  | 262/363 [00:09<00:03, 27.87it/s]
Loading 0:  73%|███████▎  | 266/363 [00:09<00:03, 25.87it/s]
Loading 0:  75%|███████▍  | 271/363 [00:09<00:03, 29.65it/s]
Loading 0:  76%|███████▌  | 275/363 [00:10<00:03, 26.60it/s]
Loading 0:  77%|███████▋  | 280/363 [00:10<00:02, 29.02it/s]
Loading 0:  78%|███████▊  | 284/363 [00:10<00:03, 26.17it/s]
Loading 0:  80%|███████▉  | 289/363 [00:10<00:02, 29.60it/s]
Loading 0:  81%|████████  | 293/363 [00:10<00:02, 26.86it/s]
Loading 0:  82%|████████▏ | 298/363 [00:10<00:02, 30.51it/s]
Loading 0:  83%|████████▎ | 303/363 [00:10<00:01, 31.02it/s]
Loading 0:  85%|████████▍ | 307/363 [00:11<00:03, 14.88it/s]
Loading 0:  86%|████████▌ | 312/363 [00:11<00:02, 17.15it/s]
Loading 0:  87%|████████▋ | 317/363 [00:11<00:02, 21.52it/s]
Loading 0:  88%|████████▊ | 321/363 [00:12<00:01, 21.83it/s]
Loading 0:  90%|████████▉ | 326/363 [00:12<00:01, 26.28it/s]
Loading 0:  91%|█████████ | 330/363 [00:12<00:01, 25.49it/s]
Loading 0:  92%|█████████▏| 335/363 [00:12<00:00, 29.57it/s]
Loading 0:  93%|█████████▎| 339/363 [00:12<00:00, 27.73it/s]
Loading 0:  95%|█████████▍| 344/363 [00:12<00:00, 32.00it/s]
Loading 0:  96%|█████████▌| 348/363 [00:12<00:00, 29.02it/s]
Loading 0:  97%|█████████▋| 353/363 [00:13<00:00, 33.18it/s]
Loading 0:  98%|█████████▊| 357/363 [00:13<00:00, 29.99it/s]
Loading 0: 100%|█████████▉| 362/363 [00:13<00:00, 33.82it/s]
                                                            
Job zmeeks-capitanito-54-2800-v2-mkmlizer completed after 118.31s with status: succeeded
Stopping job with name zmeeks-capitanito-54-2800-v2-mkmlizer
Pipeline stage MKMLizer completed in 119.19s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.18s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zmeeks-capitanito-54-2800-v2
Waiting for inference service zmeeks-capitanito-54-2800-v2 to be ready
Failed to get response for submission zmeeks-capitanito-54-3000_v7: HTTPConnectionPool(host='zmeeks-capitanito-54-3000-v7-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Failed to get response for submission chaiml-bat-boys-azeril-_87348_v1: ('http://chaiml-bat-boys-azeril-87348-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Inference service zmeeks-capitanito-54-2800-v2 ready after 311.27795600891113s
Pipeline stage MKMLDeployer completed in 312.07s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.566464424133301s
Received healthy response to inference request in 1.6469337940216064s
Failed to get response for submission zmeeks-capitanito-54-3000_v7: HTTPConnectionPool(host='zmeeks-capitanito-54-3000-v7-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 1.8601343631744385s
Received healthy response to inference request in 1.5296802520751953s
Received healthy response to inference request in 1.5678520202636719s
5 requests
0 failed requests
5th percentile: 1.5373146057128906
10th percentile: 1.5449489593505858
20th percentile: 1.5602176666259766
30th percentile: 1.5836683750152587
40th percentile: 1.6153010845184326
50th percentile: 1.6469337940216064
60th percentile: 1.7322140216827393
70th percentile: 1.817494249343872
80th percentile: 2.0014003753662113
90th percentile: 2.283932399749756
95th percentile: 2.425198411941528
99th percentile: 2.5382112216949464
mean time: 1.8342129707336425
Pipeline stage StressChecker completed in 11.20s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.83s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.73s
Shutdown handler de-registered
zmeeks-capitanito-54-2800_v2 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 5121.08s
Shutdown handler de-registered
zmeeks-capitanito-54-2800_v2 status is now inactive due to auto deactivation removed underperforming models
zmeeks-capitanito-54-2800_v2 status is now torndown due to DeploymentManager action
zmeeks-capitanito-54-2800_v2 status is now torndown due to DeploymentManager action