developer_uid: zmeeks
submission_id: zmeeks-capitanito-49-2760_v1
model_name: capitanito_t10__49-2760__ppmmp
model_group: zmeeks/capitanito__49-27
status: torndown
timestamp: 2025-07-15T14:25:24+00:00
num_battles: 6770
num_wins: 3203
celo_rating: 1245.72
family_friendly_score: 0.5816
family_friendly_standard_error: 0.006976266049972578
submission_type: basic
model_repo: zmeeks/capitanito__49-2760
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
latencies: [{'batch_size': 1, 'throughput': 0.5960305025960497, 'latency_mean': 1.6776437330245972, 'latency_p50': 1.669822096824646, 'latency_p90': 1.8441762447357177}, {'batch_size': 3, 'throughput': 1.0674036351822158, 'latency_mean': 2.7946213805675506, 'latency_p50': 2.8080837726593018, 'latency_p90': 3.09472861289978}, {'batch_size': 5, 'throughput': 1.2791949402570968, 'latency_mean': 3.8899904394149782, 'latency_p50': 3.8927210569381714, 'latency_p90': 4.369879341125488}, {'batch_size': 6, 'throughput': 1.3495189111883443, 'latency_mean': 4.4141290247440335, 'latency_p50': 4.4283058643341064, 'latency_p90': 4.925838971138001}, {'batch_size': 8, 'throughput': 1.4038605448712185, 'latency_mean': 5.664641722440719, 'latency_p50': 5.691688895225525, 'latency_p90': 6.298529052734375}, {'batch_size': 10, 'throughput': 1.4388271240516368, 'latency_mean': 6.89094566822052, 'latency_p50': 6.866521596908569, 'latency_p90': 7.805219960212708}]
gpu_counts: {'NVIDIA RTX A5000': 1}
display_name: capitanito_t10__49-2760__ppmmp
is_internal_developer: False
language_model: zmeeks/capitanito__49-2760
model_size: 13B
ranking_group: single
throughput_3p7s: 1.26
us_pacific_date: 2025-07-15
win_ratio: 0.4731166912850812
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 25, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zmeeks-capitanito-49-2760-v1-mkmlizer
Waiting for job on zmeeks-capitanito-49-2760-v1-mkmlizer to finish
zmeeks-capitanito-49-2760-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zmeeks-capitanito-49-2760-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  Version: 0.29.15                                                   ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  https://mk1.ai                                                     ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  belonging to:                                                      ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  Chai Research Corp.                                                ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-49-2760-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zmeeks-capitanito-49-2760-v1-mkmlizer: Downloaded to shared memory in 43.915s
zmeeks-capitanito-49-2760-v1-mkmlizer: Checking if zmeeks/capitanito__49-2760 already exists in ChaiML
zmeeks-capitanito-49-2760-v1-mkmlizer: Creating repo ChaiML/capitanito__49-2760 and uploading /tmp/tmpgg9hng3k to it
Failed to get response for submission junhua024-chai-1-full-066126_v69: HTTPConnectionPool(host='junhua024-chai-1-full-066126-v69-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
zmeeks-capitanito-49-2760-v1-mkmlizer: 
  0%|          | 0/6 [00:00<?, ?it/s]
 17%|█▋        | 1/6 [00:05<00:28,  5.68s/it]
 33%|███▎      | 2/6 [00:13<00:28,  7.14s/it]
 50%|█████     | 3/6 [00:21<00:22,  7.53s/it]
 67%|██████▋   | 4/6 [00:26<00:13,  6.51s/it]
 83%|████████▎ | 5/6 [00:33<00:06,  6.67s/it]
100%|██████████| 6/6 [00:34<00:00,  4.78s/it]
100%|██████████| 6/6 [00:34<00:00,  5.81s/it]
zmeeks-capitanito-49-2760-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpgg9hng3k, device:0
zmeeks-capitanito-49-2760-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission zmeeks-capitanito-49-2300_v3: HTTPConnectionPool(host='zmeeks-capitanito-49-2300-v3-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
zmeeks-capitanito-49-2760-v1-mkmlizer: quantized model in 30.166s
zmeeks-capitanito-49-2760-v1-mkmlizer: Processed model zmeeks/capitanito__49-2760 in 134.050s
zmeeks-capitanito-49-2760-v1-mkmlizer: creating bucket guanaco-mkml-models
zmeeks-capitanito-49-2760-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zmeeks-capitanito-49-2760-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zmeeks-capitanito-49-2760-v1/nvidia
zmeeks-capitanito-49-2760-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zmeeks-capitanito-49-2760-v1/nvidia/special_tokens_map.json
zmeeks-capitanito-49-2760-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zmeeks-capitanito-49-2760-v1/nvidia/config.json
zmeeks-capitanito-49-2760-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zmeeks-capitanito-49-2760-v1/nvidia/tokenizer_config.json
zmeeks-capitanito-49-2760-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zmeeks-capitanito-49-2760-v1/nvidia/tokenizer.json
zmeeks-capitanito-49-2760-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zmeeks-capitanito-49-2760-v1/nvidia/flywheel_model.0.safetensors
zmeeks-capitanito-49-2760-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:12, 27.94it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:09, 37.27it/s]
Loading 0:   4%|▍         | 15/363 [00:00<00:10, 34.79it/s]
Loading 0:   6%|▌         | 21/363 [00:00<00:08, 40.97it/s]
Loading 0:   7%|▋         | 26/363 [00:00<00:08, 41.28it/s]
Loading 0:   9%|▊         | 31/363 [00:00<00:07, 43.09it/s]
Loading 0:  10%|█         | 37/363 [00:00<00:07, 42.22it/s]
Loading 0:  12%|█▏        | 42/363 [00:01<00:07, 40.82it/s]
Loading 0:  13%|█▎        | 49/363 [00:01<00:06, 46.17it/s]
Loading 0:  15%|█▍        | 54/363 [00:01<00:06, 46.78it/s]
Loading 0:  17%|█▋        | 60/363 [00:01<00:06, 44.61it/s]
Loading 0:  18%|█▊        | 65/363 [00:01<00:10, 28.10it/s]
Loading 0:  20%|█▉        | 72/363 [00:01<00:08, 34.33it/s]
Loading 0:  21%|██        | 77/363 [00:01<00:07, 37.26it/s]
Loading 0:  23%|██▎       | 82/363 [00:02<00:08, 33.67it/s]
Loading 0:  25%|██▍       | 90/363 [00:02<00:06, 41.67it/s]
Loading 0:  26%|██▌       | 95/363 [00:02<00:06, 43.13it/s]
Loading 0:  28%|██▊       | 100/363 [00:02<00:07, 36.58it/s]
Loading 0:  29%|██▉       | 107/363 [00:02<00:05, 43.83it/s]
Loading 0:  31%|███       | 113/363 [00:02<00:06, 39.29it/s]
Loading 0:  33%|███▎      | 118/363 [00:03<00:06, 39.06it/s]
Loading 0:  34%|███▍      | 125/363 [00:03<00:05, 45.65it/s]
Loading 0:  36%|███▌      | 130/363 [00:03<00:05, 45.83it/s]
Loading 0:  37%|███▋      | 135/363 [00:03<00:05, 45.27it/s]
Loading 0:  39%|███▉      | 141/363 [00:03<00:05, 43.97it/s]
Loading 0:  40%|████      | 146/363 [00:03<00:07, 30.71it/s]
Loading 0:  41%|████▏     | 150/363 [00:03<00:06, 30.55it/s]
Loading 0:  43%|████▎     | 156/363 [00:04<00:05, 36.44it/s]
Loading 0:  44%|████▍     | 161/363 [00:04<00:05, 38.50it/s]
Loading 0:  46%|████▌     | 166/363 [00:04<00:04, 39.99it/s]
Loading 0:  47%|████▋     | 172/363 [00:04<00:04, 39.96it/s]
Loading 0:  49%|████▉     | 177/363 [00:04<00:04, 40.06it/s]
Loading 0:  50%|█████     | 183/363 [00:04<00:04, 44.08it/s]
Loading 0:  52%|█████▏    | 188/363 [00:04<00:03, 44.06it/s]
Loading 0:  53%|█████▎    | 193/363 [00:04<00:03, 44.42it/s]
Loading 0:  55%|█████▍    | 199/363 [00:04<00:03, 43.24it/s]
Loading 0:  56%|█████▌    | 204/363 [00:05<00:03, 42.14it/s]
Loading 0:  58%|█████▊    | 210/363 [00:05<00:03, 46.48it/s]
Loading 0:  59%|█████▉    | 215/363 [00:05<00:03, 45.56it/s]
Loading 0:  61%|██████    | 220/363 [00:05<00:03, 46.67it/s]
Loading 0:  62%|██████▏   | 225/363 [00:05<00:05, 27.22it/s]
Loading 0:  63%|██████▎   | 230/363 [00:05<00:04, 29.71it/s]
Loading 0:  65%|██████▌   | 237/363 [00:06<00:03, 37.62it/s]
Loading 0:  67%|██████▋   | 242/363 [00:06<00:03, 39.51it/s]
Loading 0:  68%|██████▊   | 247/363 [00:06<00:02, 41.21it/s]
Loading 0:  70%|██████▉   | 253/363 [00:06<00:02, 41.07it/s]
Loading 0:  71%|███████   | 258/363 [00:06<00:02, 40.76it/s]
Loading 0:  73%|███████▎  | 265/363 [00:06<00:02, 45.39it/s]
Loading 0:  75%|███████▍  | 271/363 [00:06<00:02, 43.42it/s]
Loading 0:  76%|███████▌  | 276/363 [00:06<00:02, 41.76it/s]
Loading 0:  78%|███████▊  | 282/363 [00:07<00:01, 46.09it/s]
Loading 0:  79%|███████▉  | 287/363 [00:07<00:01, 45.94it/s]
Loading 0:  80%|████████  | 292/363 [00:07<00:01, 45.19it/s]
Loading 0:  82%|████████▏ | 298/363 [00:07<00:01, 43.54it/s]
Loading 0:  83%|████████▎ | 303/363 [00:07<00:01, 44.91it/s]
Loading 0:  85%|████████▍ | 308/363 [00:08<00:02, 22.63it/s]
Loading 0:  86%|████████▌ | 312/363 [00:08<00:02, 23.68it/s]
Loading 0:  88%|████████▊ | 320/363 [00:08<00:01, 32.80it/s]
Loading 0:  90%|████████▉ | 326/363 [00:08<00:01, 35.25it/s]
Loading 0:  91%|█████████ | 331/363 [00:08<00:00, 36.68it/s]
Loading 0:  93%|█████████▎| 338/363 [00:08<00:00, 42.93it/s]
Loading 0:  95%|█████████▍| 344/363 [00:08<00:00, 42.22it/s]
Loading 0:  96%|█████████▌| 349/363 [00:08<00:00, 41.07it/s]
Loading 0:  98%|█████████▊| 356/363 [00:09<00:00, 46.52it/s]
Loading 0: 100%|█████████▉| 362/363 [00:09<00:00, 45.06it/s]
                                                            

Job zmeeks-capitanito-49-2760-v1-mkmlizer completed after 158.78s with status: succeeded
Stopping job with name zmeeks-capitanito-49-2760-v1-mkmlizer
Pipeline stage MKMLizer completed in 159.67s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.19s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zmeeks-capitanito-49-2760-v1
Waiting for inference service zmeeks-capitanito-49-2760-v1 to be ready
Failed to get response for submission zmeeks-capitanito-49-2300_v3: HTTPConnectionPool(host='zmeeks-capitanito-49-2300-v3-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Inference service zmeeks-capitanito-49-2760-v1 ready after 252.07954359054565s
Pipeline stage MKMLDeployer completed in 252.72s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5303075313568115s
Received healthy response to inference request in 1.7274258136749268s
Failed to get response for submission zmeeks-capitanito-49-2300_v3: HTTPConnectionPool(host='zmeeks-capitanito-49-2300-v3-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 1.9067316055297852s
Received healthy response to inference request in 1.1359975337982178s
Received healthy response to inference request in 1.5738866329193115s
5 requests
0 failed requests
5th percentile: 1.2235753536224365
10th percentile: 1.3111531734466553
20th percentile: 1.4863088130950928
30th percentile: 1.6045944690704346
40th percentile: 1.6660101413726807
50th percentile: 1.7274258136749268
60th percentile: 1.7991481304168702
70th percentile: 1.8708704471588133
80th percentile: 2.0314467906951905
90th percentile: 2.280877161026001
95th percentile: 2.405592346191406
99th percentile: 2.5053644943237305
mean time: 1.7748698234558105
Pipeline stage StressChecker completed in 10.73s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.79s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.99s
Shutdown handler de-registered
zmeeks-capitanito-49-2760_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.12s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zmeeks-capitanito-49-2760-v1-profiler
Waiting for inference service zmeeks-capitanito-49-2760-v1-profiler to be ready
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4725.47s
Shutdown handler de-registered
zmeeks-capitanito-49-2760_v1 status is now inactive due to auto deactivation removed underperforming models
zmeeks-capitanito-49-2760_v1 status is now torndown due to DeploymentManager action
zmeeks-capitanito-49-2760_v1 status is now torndown due to DeploymentManager action