developer_uid: NischayDnk
submission_id: chaiml-nis-sft-24b-dist_97349_v1
model_name: chaiml-nis-sft-24b-dist_97349_v1
model_group: ChaiML/nis-sft-24b-disti
status: torndown
timestamp: 2025-08-26T21:14:56+00:00
num_battles: 5609
num_wins: 3100
celo_rating: 1285.38
family_friendly_score: 0.5474
family_friendly_standard_error: 0.00703922211611482
submission_type: basic
model_repo: ChaiML/nis-sft-24b-distil-superhighqual-autoreg-4osblend-360convo-sftv1-top100users-nochain
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-nis-sft-24b-dist_97349_v1
is_internal_developer: False
language_model: ChaiML/nis-sft-24b-distil-superhighqual-autoreg-4osblend-360convo-sftv1-top100users-nochain
model_size: 24B
ranking_group: single
us_pacific_date: 2025-08-26
win_ratio: 0.5526831877339989
generation_params: {'temperature': 0.55, 'top_p': 0.95, 'min_p': 0.025, 'top_k': 60, 'presence_penalty': 0.4, 'frequency_penalty': 0.4, 'stopping_words': ['\n', '<|im_start|>', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '<|system|>{bot_name}memory:{memory}\n', 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{message}<|im_end|>\n', 'user_template': '<|im_start|>user\nYou:{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-nis-sft-24b-dist-97349-v1-mkmlizer
Waiting for job on chaiml-nis-sft-24b-dist-97349-v1-mkmlizer to finish
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║                                                                     ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║                                                                     ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  Version: 0.30.2                                                    ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║                                                                     ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║                                                                     ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ║                                                                     ║
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
HTTP Request: %s %s "%s %d %s"
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: Downloaded to shared memory in 63.188s
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: Checking if ChaiML/nis-sft-24b-distil-superhighqual-autoreg-4osblend-360convo-sftv1-top100users-nochain already exists in ChaiML
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp0f6g6ihp, device:0
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: quantized model in 288.657s
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: Processed model ChaiML/nis-sft-24b-distil-superhighqual-autoreg-4osblend-360convo-sftv1-top100users-nochain in 351.846s
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-nis-sft-24b-dist-97349-v1/nvidia
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-nis-sft-24b-dist-97349-v1/nvidia/config.json
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-nis-sft-24b-dist-97349-v1/nvidia/special_tokens_map.json
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-nis-sft-24b-dist-97349-v1/nvidia/tokenizer_config.json
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-nis-sft-24b-dist-97349-v1/nvidia/tokenizer.json
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-nis-sft-24b-dist-97349-v1/nvidia/flywheel_model.1.safetensors
chaiml-nis-sft-24b-dist-97349-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-nis-sft-24b-dist-97349-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-nis-sft-24b-dist-97349-v1-mkmlizer completed after 390.18s with status: succeeded
Stopping job with name chaiml-nis-sft-24b-dist-97349-v1-mkmlizer
Pipeline stage MKMLizer completed in 390.62s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.27s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-nis-sft-24b-dist-97349-v1
Waiting for inference service chaiml-nis-sft-24b-dist-97349-v1 to be ready
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-nis-sft-24b-dist-97349-v1 ready after 60.25814390182495s
Pipeline stage MKMLDeployer completed in 60.67s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5282933712005615s
Received healthy response to inference request in 1.7852468490600586s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 1.8654260635375977s
Received healthy response to inference request in 1.9521749019622803s
Received healthy response to inference request in 2.5925915241241455s
5 requests
0 failed requests
5th percentile: 1.8012826919555665
10th percentile: 1.8173185348510743
Failed to get response for submission chaiml-rumi-nsfw-kdh-ma_66303_v1: ('http://chaiml-rumi-nsfw-kdh-ma-66303-v1-predictor.creator-studio.k2.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
20th percentile: 1.8493902206420898
30th percentile: 1.8827758312225342
40th percentile: 1.9174753665924071
50th percentile: 1.9521749019622803
60th percentile: 2.182622289657593
70th percentile: 2.413069677352905
80th percentile: 2.541153001785278
90th percentile: 2.566872262954712
95th percentile: 2.579731893539429
99th percentile: 2.5900195980072023
mean time: 2.1447465419769287
Pipeline stage StressChecker completed in 12.13s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.79s
Shutdown handler de-registered
chaiml-nis-sft-24b-dist_97349_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2861.53s
Shutdown handler de-registered
chaiml-nis-sft-24b-dist_97349_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-nis-sft-24b-dist_97349_v1 status is now torndown due to DeploymentManager action