chaiml-enzo-satoru-gojo-_1139

developer_uid: chai_backend_admin

submission_id: chaiml-enzo-satoru-gojo-_1139_v1

model_name: chaiml-enzo-satoru-gojo-_1139_v1

model_group: ChaiML/Enzo_Satoru-Gojo_

status: torndown

timestamp: 2025-07-17T05:39:56+00:00

num_battles: 5391

num_wins: 2728

celo_rating: 1295.3

family_friendly_score: 0.5244

family_friendly_standard_error: 0.007062643131292986

submission_type: basic

model_repo: ChaiML/Enzo_Satoru-Gojo_Detective-Husband-POV250716223039_sft

model_architecture: MistralForCausalLM

model_num_parameters: 24096691200.0

best_of: 8

max_input_tokens: 1024

max_output_tokens: 64

reward_model: default

latencies: [{'batch_size': 1, 'throughput': 0.36830023923480637, 'latency_mean': 2.7150717616081237, 'latency_p50': 2.724389672279358, 'latency_p90': 2.987692189216614}, {'batch_size': 2, 'throughput': 0.5762337388989134, 'latency_mean': 3.4574784302711485, 'latency_p50': 3.4300931692123413, 'latency_p90': 3.8376827001571656}, {'batch_size': 3, 'throughput': 0.7217153847330608, 'latency_mean': 4.13891758441925, 'latency_p50': 4.1513248682022095, 'latency_p90': 4.561762356758118}, {'batch_size': 4, 'throughput': 0.8300535417963758, 'latency_mean': 4.7922130453586576, 'latency_p50': 4.843998312950134, 'latency_p90': 5.380051827430725}, {'batch_size': 5, 'throughput': 0.9212843329220557, 'latency_mean': 5.399159724712372, 'latency_p50': 5.3836482763290405, 'latency_p90': 6.149305105209351}]

gpu_counts: {'NVIDIA RTX A6000': 1}

display_name: chaiml-enzo-satoru-gojo-_1139_v1

is_internal_developer: True

language_model: ChaiML/Enzo_Satoru-Gojo_Detective-Husband-POV250716223039_sft

model_size: 24B

ranking_group: single

throughput_3p7s: 0.64

us_pacific_date: 2025-07-16

win_ratio: 0.506028566128733

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####\n', '\n', '####', 'You:', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}</s>\n', 'user_template': 'You: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-enzo-satoru-gojo-1139-v1-mkmlizer
Waiting for job on chaiml-enzo-satoru-gojo-1139-v1-mkmlizer to finish
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║                                                                     ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║                                                                     ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  Version: 0.29.15                                                   ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║                                                                     ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║                                                                     ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ║                                                                     ║
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: Downloaded to shared memory in 84.694s
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: Checking if ChaiML/Enzo_Satoru-Gojo_Detective-Husband-POV250716223039_sft already exists in ChaiML
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp9ozz_rhi, device:0
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: quantized model in 52.000s
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: Processed model ChaiML/Enzo_Satoru-Gojo_Detective-Husband-POV250716223039_sft in 136.694s
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-enzo-satoru-gojo-1139-v1/nvidia
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-enzo-satoru-gojo-1139-v1/nvidia/config.json
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-enzo-satoru-gojo-1139-v1/nvidia/special_tokens_map.json
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-enzo-satoru-gojo-1139-v1/nvidia/tokenizer_config.json
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-enzo-satoru-gojo-1139-v1/nvidia/tokenizer.json
chaiml-enzo-satoru-gojo-1139-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:15, 22.87it/s]
Loading 0:   3%|▎         | 12/363 [00:00<00:08, 39.24it/s]
Loading 0:   5%|▍         | 17/363 [00:00<00:09, 35.29it/s]
Loading 0:   6%|▌         | 21/363 [00:00<00:09, 35.57it/s]
Loading 0:   7%|▋         | 25/363 [00:00<00:10, 31.62it/s]
Loading 0:   9%|▉         | 32/363 [00:00<00:09, 36.47it/s]
Loading 0:  10%|▉         | 36/363 [00:01<00:15, 20.84it/s]
Loading 0:  11%|█▏        | 41/363 [00:01<00:14, 21.65it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:11, 27.92it/s]
Loading 0:  14%|█▍        | 52/363 [00:01<00:11, 27.03it/s]
Loading 0:  16%|█▌        | 57/363 [00:01<00:10, 29.06it/s]
Loading 0:  17%|█▋        | 61/363 [00:02<00:10, 28.00it/s]
Loading 0:  18%|█▊        | 65/363 [00:02<00:10, 28.72it/s]
Loading 0:  19%|█▉        | 70/363 [00:02<00:13, 22.51it/s]
Loading 0:  20%|██        | 73/363 [00:02<00:14, 20.18it/s]
Loading 0:  22%|██▏       | 79/363 [00:02<00:11, 25.44it/s]
Loading 0:  23%|██▎       | 82/363 [00:03<00:11, 24.67it/s]
Loading 0:  24%|██▎       | 86/363 [00:03<00:10, 26.47it/s]
Loading 0:  25%|██▍       | 89/363 [00:03<00:10, 26.30it/s]
Loading 0:  25%|██▌       | 92/363 [00:03<00:12, 21.73it/s]
Loading 0:  27%|██▋       | 99/363 [00:03<00:09, 28.73it/s]
Loading 0:  28%|██▊       | 103/363 [00:03<00:09, 27.81it/s]
Loading 0:  29%|██▉       | 107/363 [00:04<00:12, 20.79it/s]
Loading 0:  31%|███       | 112/363 [00:04<00:10, 24.93it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:09, 25.01it/s]
Loading 0:  33%|███▎      | 120/363 [00:04<00:08, 27.28it/s]
Loading 0:  34%|███▍      | 123/363 [00:04<00:09, 24.84it/s]
Loading 0:  36%|███▌      | 129/363 [00:04<00:07, 29.63it/s]
Loading 0:  37%|███▋      | 133/363 [00:05<00:08, 28.22it/s]
Loading 0:  38%|███▊      | 138/363 [00:05<00:07, 30.54it/s]
Loading 0:  39%|███▉      | 142/363 [00:05<00:07, 28.89it/s]
Loading 0:  40%|████      | 147/363 [00:05<00:06, 33.18it/s]
Loading 0:  42%|████▏     | 151/363 [00:05<00:09, 21.93it/s]
Loading 0:  42%|████▏     | 154/363 [00:05<00:09, 21.33it/s]
Loading 0:  44%|████▎     | 158/363 [00:06<00:09, 20.71it/s]
Loading 0:  45%|████▍     | 163/363 [00:06<00:07, 25.97it/s]
Loading 0:  46%|████▌     | 167/363 [00:06<00:08, 23.68it/s]
Loading 0:  48%|████▊     | 174/363 [00:06<00:06, 30.19it/s]
Loading 0:  49%|████▉     | 178/363 [00:06<00:06, 28.23it/s]
Loading 0:  50%|█████     | 182/363 [00:06<00:06, 28.20it/s]
Loading 0:  52%|█████▏    | 187/363 [00:07<00:07, 22.31it/s]
Loading 0:  52%|█████▏    | 190/363 [00:07<00:08, 21.55it/s]
Loading 0:  53%|█████▎    | 194/363 [00:07<00:08, 20.61it/s]
Loading 0:  55%|█████▍    | 199/363 [00:07<00:06, 25.74it/s]
Loading 0:  55%|█████▌    | 200/363 [00:24<00:06, 25.74it/s]
Loading 0:  55%|█████▌    | 201/363 [00:24<03:47,  1.41s/it]
Loading 0:  56%|█████▌    | 203/363 [00:24<03:05,  1.16s/it]
Loading 0:  57%|█████▋    | 208/363 [00:24<01:48,  1.42it/s]
Loading 0:  58%|█████▊    | 211/363 [00:24<01:22,  1.85it/s]
Loading 0:  59%|█████▉    | 214/363 [00:25<01:00,  2.46it/s]
Loading 0:  60%|██████    | 218/363 [00:25<00:40,  3.57it/s]
Loading 0:  61%|██████    | 221/363 [00:25<00:30,  4.59it/s]
Loading 0:  62%|██████▏   | 224/363 [00:25<00:26,  5.31it/s]
Loading 0:  63%|██████▎   | 229/363 [00:25<00:16,  8.11it/s]
Loading 0:  64%|██████▍   | 232/363 [00:25<00:13,  9.76it/s]
Loading 0:  65%|██████▌   | 237/363 [00:26<00:09, 13.49it/s]
Loading 0:  66%|██████▌   | 240/363 [00:26<00:08, 14.51it/s]
Loading 0:  68%|██████▊   | 246/363 [00:26<00:05, 19.69it/s]
Loading 0:  69%|██████▉   | 250/363 [00:26<00:05, 20.82it/s]
Loading 0:  70%|███████   | 255/363 [00:26<00:04, 24.01it/s]
Loading 0:  71%|███████▏  | 259/363 [00:26<00:04, 24.00it/s]
Loading 0:  73%|███████▎  | 264/363 [00:27<00:03, 28.72it/s]
Loading 0:  74%|███████▍  | 268/363 [00:27<00:04, 20.06it/s]
Loading 0:  75%|███████▍  | 271/363 [00:27<00:04, 19.81it/s]
Loading 0:  76%|███████▌  | 275/363 [00:27<00:04, 19.52it/s]
Loading 0:  78%|███████▊  | 282/363 [00:27<00:03, 26.20it/s]
Loading 0:  79%|███████▉  | 286/363 [00:28<00:02, 25.88it/s]
Loading 0:  80%|████████  | 291/363 [00:28<00:02, 28.34it/s]
Loading 0:  81%|████████▏ | 295/363 [00:28<00:02, 27.07it/s]
Loading 0:  82%|████████▏ | 299/363 [00:28<00:02, 27.50it/s]
Loading 0:  84%|████████▎ | 304/363 [00:28<00:02, 21.50it/s]
Loading 0:  85%|████████▍ | 307/363 [00:28<00:02, 21.01it/s]
Loading 0:  86%|████████▌ | 311/363 [00:29<00:02, 20.51it/s]
Loading 0:  88%|████████▊ | 318/363 [00:29<00:01, 26.93it/s]
Loading 0:  88%|████████▊ | 321/363 [00:29<00:01, 24.91it/s]
Loading 0:  90%|█████████ | 327/363 [00:29<00:01, 28.90it/s]
Loading 0:  91%|█████████ | 331/363 [00:29<00:01, 27.56it/s]
Loading 0:  92%|█████████▏| 335/363 [00:29<00:01, 27.75it/s]
Loading 0:  93%|█████████▎| 338/363 [00:30<00:00, 26.29it/s]
Loading 0:  94%|█████████▍| 341/363 [00:30<00:01, 14.92it/s]
Loading 0:  96%|█████████▌| 347/363 [00:30<00:00, 20.96it/s]
Loading 0:  96%|█████████▋| 350/363 [00:30<00:00, 21.19it/s]
Loading 0:  97%|█████████▋| 353/363 [00:30<00:00, 22.79it/s]
Loading 0:  98%|█████████▊| 357/363 [00:31<00:00, 21.74it/s]
                                                            
Job chaiml-enzo-satoru-gojo-1139-v1-mkmlizer completed after 409.16s with status: succeeded
Stopping job with name chaiml-enzo-satoru-gojo-1139-v1-mkmlizer
Pipeline stage MKMLizer completed in 409.71s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.19s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-enzo-satoru-gojo-1139-v1
Waiting for inference service chaiml-enzo-satoru-gojo-1139-v1 to be ready
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Inference service chaiml-enzo-satoru-gojo-1139-v1 ready after 291.90443873405457s
Pipeline stage MKMLDeployer completed in 292.71s
run pipeline stage %s
Running pipeline stage StressChecker
Failed to get response for submission b1: no entry with id "b1" found on database!
Failed to get response for submission b2: no entry with id "b2" found on database!
Received healthy response to inference request in 3.1527931690216064s
Failed to get response for submission b2: no entry with id "b2" found on database!
Failed to get response for submission b1: no entry with id "b1" found on database!
Received healthy response to inference request in 2.592195510864258s
Received healthy response to inference request in 2.5004425048828125s
Received healthy response to inference request in 2.5652103424072266s
Received healthy response to inference request in 2.4190127849578857s
5 requests
0 failed requests
5th percentile: 2.435298728942871
10th percentile: 2.4515846729278565
20th percentile: 2.4841565608978273
30th percentile: 2.513396072387695
40th percentile: 2.539303207397461
50th percentile: 2.5652103424072266
60th percentile: 2.576004409790039
70th percentile: 2.5867984771728514
80th percentile: 2.7043150424957276
90th percentile: 2.928554105758667
95th percentile: 3.0406736373901366
99th percentile: 3.1303692626953126
mean time: 2.645930862426758
Pipeline stage StressChecker completed in 15.02s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.75s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.71s
Shutdown handler de-registered
chaiml-enzo-satoru-gojo-_1139_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.16s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.10s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service chaiml-enzo-satoru-gojo-1139-v1-profiler
Waiting for inference service chaiml-enzo-satoru-gojo-1139-v1-profiler to be ready
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4767.25s
Shutdown handler de-registered
chaiml-enzo-satoru-gojo-_1139_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-enzo-satoru-gojo-_1139_v1 status is now torndown due to DeploymentManager action
chaiml-enzo-satoru-gojo-_1139_v1 status is now torndown due to DeploymentManager action
chaiml-enzo-satoru-gojo-_1139_v1 status is now torndown due to DeploymentManager action
chaiml-enzo-satoru-gojo-_1139_v1 status is now torndown due to DeploymentManager action