developer_uid: zmeeks
submission_id: zmeeks-capitanito-28_v1
model_name: capitanito_t11__28__ppmmp
model_group: zmeeks/capitanito__28
status: torndown
timestamp: 2025-07-12T19:25:55+00:00
num_battles: 8297
num_wins: 3904
celo_rating: 1258.42
family_friendly_score: 0.5618000000000001
family_friendly_standard_error: 0.007016847725296595
submission_type: basic
model_repo: zmeeks/capitanito__28
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
latencies: [{'batch_size': 1, 'throughput': 0.5958953028025356, 'latency_mean': 1.678026169538498, 'latency_p50': 1.6813194751739502, 'latency_p90': 1.8550371646881103}, {'batch_size': 3, 'throughput': 1.077719903708569, 'latency_mean': 2.7765374290943146, 'latency_p50': 2.7704126834869385, 'latency_p90': 3.0246337413787843}, {'batch_size': 5, 'throughput': 1.2894335157486156, 'latency_mean': 3.8533570766448975, 'latency_p50': 3.882874846458435, 'latency_p90': 4.295701289176941}, {'batch_size': 6, 'throughput': 1.362421704657988, 'latency_mean': 4.368097723722458, 'latency_p50': 4.396589636802673, 'latency_p90': 4.886184930801392}, {'batch_size': 8, 'throughput': 1.4343673858510557, 'latency_mean': 5.539977425336838, 'latency_p50': 5.564681172370911, 'latency_p90': 6.257378888130188}, {'batch_size': 10, 'throughput': 1.4580238715263436, 'latency_mean': 6.801173323392868, 'latency_p50': 6.815221309661865, 'latency_p90': 7.675855875015259}]
gpu_counts: {'NVIDIA RTX A5000': 1}
display_name: capitanito_t11__28__ppmmp
is_internal_developer: False
language_model: zmeeks/capitanito__28
model_size: 13B
ranking_group: single
throughput_3p7s: 1.27
us_pacific_date: 2025-07-12
win_ratio: 0.47053151741593346
generation_params: {'temperature': 1.1, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 25, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zmeeks-capitanito-28-v1-mkmlizer
Waiting for job on zmeeks-capitanito-28-v1-mkmlizer to finish
zmeeks-capitanito-28-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zmeeks-capitanito-28-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-28-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
zmeeks-capitanito-28-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
zmeeks-capitanito-28-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
zmeeks-capitanito-28-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
zmeeks-capitanito-28-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
zmeeks-capitanito-28-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
zmeeks-capitanito-28-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
zmeeks-capitanito-28-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
zmeeks-capitanito-28-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-28-v1-mkmlizer: ║  Version: 0.29.15                                                   ║
zmeeks-capitanito-28-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
zmeeks-capitanito-28-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
zmeeks-capitanito-28-v1-mkmlizer: ║  https://mk1.ai                                                     ║
zmeeks-capitanito-28-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-28-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
zmeeks-capitanito-28-v1-mkmlizer: ║  belonging to:                                                      ║
zmeeks-capitanito-28-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-28-v1-mkmlizer: ║  Chai Research Corp.                                                ║
zmeeks-capitanito-28-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zmeeks-capitanito-28-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
zmeeks-capitanito-28-v1-mkmlizer: ║                                                                     ║
zmeeks-capitanito-28-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zmeeks-capitanito-28-v1-mkmlizer: Downloaded to shared memory in 45.356s
zmeeks-capitanito-28-v1-mkmlizer: Checking if zmeeks/capitanito__28 already exists in ChaiML
zmeeks-capitanito-28-v1-mkmlizer: Creating repo ChaiML/capitanito__28 and uploading /tmp/tmpnsu7ft1h to it
zmeeks-capitanito-28-v1-mkmlizer: 
  0%|          | 0/6 [00:00<?, ?it/s]
 17%|█▋        | 1/6 [00:09<00:49,  9.82s/it]
 33%|███▎      | 2/6 [00:15<00:29,  7.34s/it]
 50%|█████     | 3/6 [00:20<00:18,  6.26s/it]
 67%|██████▋   | 4/6 [00:25<00:11,  5.77s/it]
 83%|████████▎ | 5/6 [00:30<00:05,  5.50s/it]
100%|██████████| 6/6 [00:31<00:00,  4.08s/it]
100%|██████████| 6/6 [00:31<00:00,  5.29s/it]
zmeeks-capitanito-28-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpnsu7ft1h, device:0
zmeeks-capitanito-28-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zmeeks-capitanito-28-v1-mkmlizer: quantized model in 39.752s
zmeeks-capitanito-28-v1-mkmlizer: Processed model zmeeks/capitanito__28 in 151.539s
zmeeks-capitanito-28-v1-mkmlizer: creating bucket guanaco-mkml-models
zmeeks-capitanito-28-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zmeeks-capitanito-28-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zmeeks-capitanito-28-v1/nvidia
zmeeks-capitanito-28-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zmeeks-capitanito-28-v1/nvidia/config.json
zmeeks-capitanito-28-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zmeeks-capitanito-28-v1/nvidia/special_tokens_map.json
zmeeks-capitanito-28-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zmeeks-capitanito-28-v1/nvidia/tokenizer_config.json
zmeeks-capitanito-28-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zmeeks-capitanito-28-v1/nvidia/tokenizer.json
zmeeks-capitanito-28-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zmeeks-capitanito-28-v1/nvidia/flywheel_model.0.safetensors
Job zmeeks-capitanito-28-v1-mkmlizer completed after 187.59s with status: succeeded
Stopping job with name zmeeks-capitanito-28-v1-mkmlizer
Pipeline stage MKMLizer completed in 188.45s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.17s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zmeeks-capitanito-28-v1
Waiting for inference service zmeeks-capitanito-28-v1 to be ready
Inference service zmeeks-capitanito-28-v1 ready after 220.96051597595215s
Pipeline stage MKMLDeployer completed in 221.52s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1786704063415527s
Received healthy response to inference request in 1.6775949001312256s
Failed to get response for submission blend_hunen_2025-06-23: HTTPConnectionPool(host='guanaco-model-mesh.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 1.5060436725616455s
Received healthy response to inference request in 1.6869559288024902s
Received healthy response to inference request in 1.6779277324676514s
5 requests
0 failed requests
5th percentile: 1.5403539180755614
10th percentile: 1.5746641635894776
20th percentile: 1.6432846546173097
30th percentile: 1.6776614665985108
40th percentile: 1.677794599533081
50th percentile: 1.6779277324676514
60th percentile: 1.6815390110015869
70th percentile: 1.6851502895355224
80th percentile: 1.7852988243103027
90th percentile: 1.9819846153259277
95th percentile: 2.0803275108337402
99th percentile: 2.1590018272399902
mean time: 1.745438528060913
Pipeline stage StressChecker completed in 10.33s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.65s
Shutdown handler de-registered
zmeeks-capitanito-28_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.11s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.09s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zmeeks-capitanito-28-v1-profiler
Waiting for inference service zmeeks-capitanito-28-v1-profiler to be ready
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 6282.31s
Shutdown handler de-registered
zmeeks-capitanito-28_v1 status is now inactive due to auto deactivation removed underperforming models
zmeeks-capitanito-28_v1 status is now torndown due to DeploymentManager action