developer_uid: ChaiHarshitSheoran
submission_id: chaiml-mn24b-v2preferwi_13902_v1
model_name: chaiml-mn24b-v2preferwi_13902_v1
model_group: ChaiML/mn24b_v2preferwin
status: failed
timestamp: 2025-09-30T12:34:58+00:00
num_battles: 361
num_wins: 176
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/mn24b_v2preferwin2_qwen_nonl_bo1_fft6
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-mn24b-v2preferwi_13902_v1
ineligible_reason: model is not deployable
is_internal_developer: False
language_model: ChaiML/mn24b_v2preferwin2_qwen_nonl_bo1_fft6
model_size: 24B
ranking_group: single
us_pacific_date: 2025-09-30
win_ratio: 0.48753462603878117
generation_params: {'temperature': 0.6, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mn24b-v2preferwi-13902-v1-mkmlizer
Waiting for job on chaiml-mn24b-v2preferwi-13902-v1-mkmlizer to finish
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Version: 0.30.2                                                    ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: Downloaded to shared memory in 53.807s
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: Checking if ChaiML/mn24b_v2preferwin2_qwen_nonl_bo1_fft6 already exists in ChaiML
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp4bqib845, device:0
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission chaiml-jace-lightwood-s_43552_v2: HTTPConnectionPool(host='chaiml-jace-lightwood-s-43552-v2-predictor.creator-studio.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Failed to get response for submission chaiml-high-school-life_46597_v2: HTTPConnectionPool(host='chaiml-high-school-life-46597-v2-predictor.creator-studio.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Failed to get response for submission chaiml-llama38b-1800seqt_5646_v1: HTTPConnectionPool(host='chaiml-llama38b-1800seqt-5646-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Failed to get response for submission chaiml-jace-lightwood-s_43552_v2: HTTPConnectionPool(host='chaiml-jace-lightwood-s-43552-v2-predictor.creator-studio.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Failed to get response for submission chaiml-llama38b-1800seqt_5646_v1: HTTPConnectionPool(host='chaiml-llama38b-1800seqt-5646-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: quantized model in 284.281s
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: Processed model ChaiML/mn24b_v2preferwin2_qwen_nonl_bo1_fft6 in 338.088s
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mn24b-v2preferwi-13902-v1/nvidia
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mn24b-v2preferwi-13902-v1/nvidia/config.json
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mn24b-v2preferwi-13902-v1/nvidia/special_tokens_map.json
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mn24b-v2preferwi-13902-v1/nvidia/tokenizer_config.json
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mn24b-v2preferwi-13902-v1/nvidia/tokenizer.json
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mn24b-v2preferwi-13902-v1/nvidia/flywheel_model.1.safetensors
Stopping job with name chaiml-mn24b-v2preferwi-13902-v1-mkmlizer
%s, retrying in %s seconds...
Stopping job with name chaiml-mn24b-v2preferwi-13902-v1-mkmlizer
%s, retrying in %s seconds...
Stopping job with name chaiml-mn24b-v2preferwi-13902-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name chaiml-mn24b-v2preferwi-13902-v1-mkmlizer
Waiting for job on chaiml-mn24b-v2preferwi-13902-v1-mkmlizer to finish
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Version: 0.30.2                                                    ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ║                                                                     ║
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: Downloaded to shared memory in 51.823s
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: Checking if ChaiML/mn24b_v2preferwin2_qwen_nonl_bo1_fft6 already exists in ChaiML
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpo5pni9ne, device:0
chaiml-mn24b-v2preferwi-13902-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3343.32s
Shutdown handler de-registered