epiculous-violet-twili_46660

developer_uid: zmeeks

submission_id: epiculous-violet-twili_46660_v21

model_name: violet-cm0909

model_group: Epiculous/Violet_Twiligh

status: torndown

timestamp: 2025-06-28T21:01:42+00:00

num_battles: 6117

num_wins: 2959

celo_rating: 1260.29

family_friendly_score: 0.5694

family_friendly_standard_error: 0.00700262293715719

submission_type: basic

model_repo: Epiculous/Violet_Twilight-v0.2

model_architecture: MistralForCausalLM

model_num_parameters: 12772070400.0

best_of: 8

max_input_tokens: 1024

max_output_tokens: 64

reward_model: default

latencies: [{'batch_size': 1, 'throughput': 0.6007371719687311, 'latency_mean': 1.6644348549842833, 'latency_p50': 1.6627806425094604, 'latency_p90': 1.8434569358825683}, {'batch_size': 3, 'throughput': 1.0717709219872391, 'latency_mean': 2.7895319390296938, 'latency_p50': 2.7995378971099854, 'latency_p90': 3.099072527885437}, {'batch_size': 5, 'throughput': 1.280493092223682, 'latency_mean': 3.8877313601970673, 'latency_p50': 3.893322467803955, 'latency_p90': 4.365198636054993}, {'batch_size': 6, 'throughput': 1.3278804248854292, 'latency_mean': 4.481276003122329, 'latency_p50': 4.492525339126587, 'latency_p90': 5.064171028137207}, {'batch_size': 8, 'throughput': 1.4082743599351628, 'latency_mean': 5.643415539264679, 'latency_p50': 5.627546548843384, 'latency_p90': 6.284299969673157}, {'batch_size': 10, 'throughput': 1.435998887677959, 'latency_mean': 6.914039987325668, 'latency_p50': 6.920776963233948, 'latency_p90': 7.902044439315795}]

gpu_counts: {'NVIDIA RTX A5000': 1}

display_name: violet-cm0909

is_internal_developer: False

language_model: Epiculous/Violet_Twilight-v0.2

model_size: 13B

ranking_group: single

throughput_3p7s: 1.26

us_pacific_date: 2025-06-28

win_ratio: 0.4837338564655877

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '<|im_start|>user\n{prompt}<|im_end|>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name epiculous-violet-twili-46660-v21-mkmlizer
Waiting for job on epiculous-violet-twili-46660-v21-mkmlizer to finish
epiculous-violet-twili-46660-v21-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
epiculous-violet-twili-46660-v21-mkmlizer: ║                                                                     ║
epiculous-violet-twili-46660-v21-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
epiculous-violet-twili-46660-v21-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
epiculous-violet-twili-46660-v21-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
epiculous-violet-twili-46660-v21-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
epiculous-violet-twili-46660-v21-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
epiculous-violet-twili-46660-v21-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
epiculous-violet-twili-46660-v21-mkmlizer: ║                                                                     ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  Version: 0.29.3                                                    ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  https://mk1.ai                                                     ║
epiculous-violet-twili-46660-v21-mkmlizer: ║                                                                     ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  The license key for the current software has been verified as      ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  belonging to:                                                      ║
epiculous-violet-twili-46660-v21-mkmlizer: ║                                                                     ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  Chai Research Corp.                                                ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
epiculous-violet-twili-46660-v21-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
epiculous-violet-twili-46660-v21-mkmlizer: ║                                                                     ║
epiculous-violet-twili-46660-v21-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Failed to get response for submission latitudegames-wayfarer-12b_v11: HTTPConnectionPool(host='latitudegames-wayfarer-12b-v11-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Failed to get response for submission latitudegames-wayfarer-12b_v11: HTTPConnectionPool(host='latitudegames-wayfarer-12b-v11-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Failed to get response for submission latitudegames-wayfarer-12b_v11: HTTPConnectionPool(host='latitudegames-wayfarer-12b-v11-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
epiculous-violet-twili-46660-v21-mkmlizer: Downloaded to shared memory in 234.168s
epiculous-violet-twili-46660-v21-mkmlizer: Checking if Epiculous/Violet_Twilight-v0.2 already exists in ChaiML
epiculous-violet-twili-46660-v21-mkmlizer: Creating repo ChaiML/Violet_Twilight-v0.2 and uploading /tmp/tmpatamrf5s to it
epiculous-violet-twili-46660-v21-mkmlizer: 
  0%|          | 0/5 [00:00<?, ?it/s]
 20%|██        | 1/5 [00:06<00:27,  6.79s/it]
 40%|████      | 2/5 [00:13<00:20,  6.82s/it]
 60%|██████    | 3/5 [00:17<00:10,  5.34s/it]
 80%|████████  | 4/5 [00:20<00:04,  4.64s/it]
100%|██████████| 5/5 [00:24<00:00,  4.24s/it]
100%|██████████| 5/5 [00:24<00:00,  4.86s/it]
epiculous-violet-twili-46660-v21-mkmlizer: quantized model in 29.830s
epiculous-violet-twili-46660-v21-mkmlizer: Processed model Epiculous/Violet_Twilight-v0.2 in 319.189s
epiculous-violet-twili-46660-v21-mkmlizer: creating bucket guanaco-mkml-models
epiculous-violet-twili-46660-v21-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
epiculous-violet-twili-46660-v21-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/epiculous-violet-twili-46660-v21
epiculous-violet-twili-46660-v21-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/epiculous-violet-twili-46660-v21/tokenizer.json
epiculous-violet-twili-46660-v21-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/epiculous-violet-twili-46660-v21/flywheel_model.0.safetensors
epiculous-violet-twili-46660-v21-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 2/363 [00:06<18:33,  3.08s/it]
Loading 0:   2%|▏         | 6/363 [00:06<04:55,  1.21it/s]
Loading 0:   4%|▎         | 13/363 [00:06<01:44,  3.34it/s]
Loading 0:   5%|▍         | 17/363 [00:06<01:10,  4.88it/s]
Loading 0:   6%|▋         | 23/363 [00:06<00:42,  7.96it/s]
Loading 0:   8%|▊         | 29/363 [00:06<00:29, 11.37it/s]
Loading 0:   9%|▉         | 34/363 [00:06<00:22, 14.68it/s]
Loading 0:  11%|█         | 40/363 [00:07<00:19, 16.70it/s]
Loading 0:  12%|█▏        | 44/363 [00:07<00:16, 19.37it/s]
Loading 0:  14%|█▍        | 50/363 [00:07<00:12, 24.88it/s]
Loading 0:  15%|█▌        | 56/363 [00:07<00:10, 28.29it/s]
Loading 0:  17%|█▋        | 61/363 [00:07<00:09, 31.14it/s]
Loading 0:  18%|█▊        | 67/363 [00:07<00:08, 36.71it/s]
Loading 0:  20%|█▉        | 72/363 [00:07<00:07, 39.07it/s]
Loading 0:  21%|██        | 77/363 [00:07<00:06, 41.17it/s]
Loading 0:  23%|██▎       | 83/363 [00:08<00:06, 40.18it/s]
Loading 0:  24%|██▍       | 88/363 [00:08<00:06, 39.57it/s]
Loading 0:  26%|██▌       | 94/363 [00:08<00:06, 44.09it/s]
Loading 0:  27%|██▋       | 99/363 [00:08<00:06, 43.63it/s]
Loading 0:  29%|██▊       | 104/363 [00:08<00:05, 43.36it/s]
Loading 0:  30%|███       | 110/363 [00:08<00:06, 41.13it/s]
Loading 0:  32%|███▏      | 115/363 [00:08<00:06, 40.54it/s]
Loading 0:  33%|███▎      | 121/363 [00:09<00:07, 32.12it/s]
Loading 0:  34%|███▍      | 125/363 [00:09<00:07, 33.02it/s]
Loading 0:  36%|███▌      | 131/363 [00:09<00:06, 37.63it/s]
Loading 0:  37%|███▋      | 136/363 [00:09<00:05, 40.31it/s]
Loading 0:  39%|███▉      | 141/363 [00:09<00:06, 35.23it/s]
Loading 0:  41%|████      | 148/363 [00:09<00:05, 42.35it/s]
Loading 0:  42%|████▏     | 153/363 [00:09<00:04, 42.71it/s]
Loading 0:  44%|████▎     | 158/363 [00:10<00:04, 42.54it/s]
Loading 0:  45%|████▍     | 163/363 [00:10<00:04, 44.39it/s]
Loading 0:  46%|████▋     | 168/363 [00:10<00:05, 37.17it/s]
Loading 0:  48%|████▊     | 175/363 [00:10<00:04, 43.37it/s]
Loading 0:  50%|████▉     | 180/363 [00:10<00:04, 42.23it/s]
Loading 0:  51%|█████     | 185/363 [00:10<00:04, 41.87it/s]
Loading 0:  52%|█████▏    | 190/363 [00:10<00:03, 43.87it/s]
Loading 0:  54%|█████▎    | 195/363 [00:10<00:04, 36.15it/s]
Loading 0:  56%|█████▌    | 202/363 [00:11<00:05, 31.79it/s]
Loading 0:  57%|█████▋    | 206/363 [00:11<00:04, 32.32it/s]
Loading 0:  58%|█████▊    | 211/363 [00:11<00:04, 34.78it/s]
Loading 0:  59%|█████▉    | 215/363 [00:11<00:04, 34.65it/s]
Loading 0:  61%|██████    | 220/363 [00:11<00:03, 37.48it/s]
Loading 0:  62%|██████▏   | 224/363 [00:11<00:03, 36.51it/s]
Loading 0:  63%|██████▎   | 229/363 [00:11<00:03, 38.27it/s]
Loading 0:  64%|██████▍   | 233/363 [00:12<00:03, 38.09it/s]
Loading 0:  66%|██████▌   | 238/363 [00:12<00:03, 41.16it/s]
Loading 0:  67%|██████▋   | 243/363 [00:12<00:02, 42.19it/s]
Loading 0:  68%|██████▊   | 248/363 [00:12<00:02, 41.86it/s]
Loading 0:  70%|██████▉   | 254/363 [00:12<00:02, 40.52it/s]
Loading 0:  71%|███████▏  | 259/363 [00:12<00:02, 39.97it/s]
Loading 0:  73%|███████▎  | 265/363 [00:12<00:02, 43.01it/s]
Loading 0:  74%|███████▍  | 270/363 [00:12<00:02, 43.02it/s]
Loading 0:  76%|███████▌  | 275/363 [00:13<00:02, 43.64it/s]
Loading 0:  77%|███████▋  | 281/363 [00:13<00:01, 41.49it/s]
Loading 0:  79%|███████▉  | 286/363 [00:13<00:02, 29.25it/s]
Loading 0:  80%|████████  | 292/363 [00:13<00:02, 34.49it/s]
Loading 0:  82%|████████▏ | 297/363 [00:13<00:01, 36.50it/s]
Loading 0:  83%|████████▎ | 302/363 [00:13<00:01, 38.49it/s]
Loading 0:  85%|████████▍ | 307/363 [00:13<00:01, 41.08it/s]
Loading 0:  86%|████████▌ | 312/363 [00:14<00:01, 33.89it/s]
Loading 0:  88%|████████▊ | 319/363 [00:14<00:01, 41.02it/s]
Loading 0:  89%|████████▉ | 324/363 [00:14<00:00, 41.94it/s]
Loading 0:  91%|█████████ | 329/363 [00:14<00:00, 42.82it/s]
Loading 0:  92%|█████████▏| 334/363 [00:14<00:00, 44.64it/s]
Loading 0:  93%|█████████▎| 339/363 [00:14<00:00, 37.23it/s]
Loading 0:  95%|█████████▌| 346/363 [00:14<00:00, 44.28it/s]
Loading 0:  97%|█████████▋| 351/363 [00:14<00:00, 43.25it/s]
Loading 0:  98%|█████████▊| 356/363 [00:15<00:00, 42.98it/s]
Loading 0: 100%|█████████▉| 362/363 [00:15<00:00, 41.36it/s]
                                                            
Job epiculous-violet-twili-46660-v21-mkmlizer completed after 352.97s with status: succeeded
Stopping job with name epiculous-violet-twili-46660-v21-mkmlizer
Pipeline stage MKMLizer completed in 353.76s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.17s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service epiculous-violet-twili-46660-v21
Waiting for inference service epiculous-violet-twili-46660-v21 to be ready
Failed to get response for submission latitudegames-wayfarer-12b_v11: HTTPConnectionPool(host='latitudegames-wayfarer-12b-v11-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Inference service epiculous-violet-twili-46660-v21 ready after 170.85259127616882s
Pipeline stage MKMLDeployer completed in 171.32s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.9512293338775635s
Received healthy response to inference request in 1.768174648284912s
Received healthy response to inference request in 2.057227849960327s
Received healthy response to inference request in 1.7564036846160889s
5 requests
1 failed requests
5th percentile: 1.7587578773498536
10th percentile: 1.7611120700836183
20th percentile: 1.7658204555511474
30th percentile: 1.8047855854034425
40th percentile: 1.878007459640503
50th percentile: 1.9512293338775635
60th percentile: 1.993628740310669
70th percentile: 2.0360281467437744
80th percentile: 5.677899312973025
90th percentile: 12.919242238998415
95th percentile: 16.539913702011106
99th percentile: 19.436450872421265
mean time: 5.538724136352539
%s, retrying in %s seconds...
Received healthy response to inference request in 1.4980034828186035s
Received healthy response to inference request in 1.701371192932129s
Received healthy response to inference request in 1.6125550270080566s
Received healthy response to inference request in 1.7427043914794922s
Received healthy response to inference request in 1.7542445659637451s
5 requests
0 failed requests
5th percentile: 1.520913791656494
10th percentile: 1.5438241004943847
20th percentile: 1.589644718170166
30th percentile: 1.6303182601928712
40th percentile: 1.6658447265625
50th percentile: 1.701371192932129
60th percentile: 1.7179044723510741
70th percentile: 1.7344377517700196
80th percentile: 1.7450124263763427
90th percentile: 1.749628496170044
95th percentile: 1.7519365310668946
99th percentile: 1.753782958984375
mean time: 1.6617757320404052
Pipeline stage StressChecker completed in 38.55s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.85s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.72s
Shutdown handler de-registered
epiculous-violet-twili_46660_v21 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.15s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.13s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service epiculous-violet-twili-46660-v21-profiler
Waiting for inference service epiculous-violet-twili-46660-v21-profiler to be ready
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3259.28s
Shutdown handler de-registered
epiculous-violet-twili_46660_v21 status is now inactive due to auto deactivation removed underperforming models
epiculous-violet-twili_46660_v21 status is now torndown due to DeploymentManager action