Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral31-24b-s-69496-v12-mkmlizer
Waiting for job on chaiml-mistral31-24b-s-69496-v12-mkmlizer to finish
HTTP Request: %s %s "%s %d %s"
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer
Waiting for job on chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer to finish
HTTP Request: %s %s "%s %d %s"
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ║
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-slerpv5-mistral-24540-v19-mkmlizer: Downloaded to shared memory in 69.874s
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-slerpv5-mistral-24540-v19-mkmlizer: Checking if ChaiML/slerpv5_mistral31_simpo_dpo_dpoold_s2 already exists in ChaiML
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-slerpv5-mistral-24540-v19-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp0trp5w3t, device:0
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-slerpv5-mistral-24540-v19-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
HTTP Request: %s %s "%s %d %s"
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ║
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ Version: 0.29.3 ║
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ https://mk1.ai ║
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ║
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ The license key for the current software has been verified as ║
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ belonging to: ║
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ║
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ Chai Research Corp. ║
run pipeline %s
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
run pipeline stage %s
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
Running pipeline stage MKMLizer
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ║ ║
Starting job with name chaiml-anthropic-40k-2-11629-v11-mkmlizer
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
Waiting for job on chaiml-anthropic-40k-2-11629-v11-mkmlizer to finish
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ Version: 0.29.3 ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ Version: 0.29.3 ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ https://mk1.ai ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ Version: 0.29.3 ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ The license key for the current software has been verified as ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ belonging to: ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ belonging to: ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ https://mk1.ai ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ Chai Research Corp. ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ belonging to: ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ║ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ║ ║
chaiml-mistral31-24b-s-69496-v12-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ Chai Research Corp. ║
chaiml-anthropic-40k-2-11629-v11-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ║ ║
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
2 validation errors for MultiheadRewardSubmission
platform
unexpected value; permitted: 'multihead_reward' (type=value_error.const; given=coreweave/mkml; permitted=('multihead_reward',))
weights
field required (type=value_error.missing)
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for RewardSubmission
platform
unexpected value; permitted: 'reward' (type=value_error.const; given=coreweave/mkml; permitted=('reward',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-mistral31-24b-s-69496-v12-mkmlizer: Downloaded to shared memory in 69.493s
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-mistral31-24b-s-69496-v12-mkmlizer: Checking if ChaiML/mistral31-24b-simpoexp1-s1-new-sft-retryv2top20lex-2e already exists in ChaiML
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-mistral31-24b-s-69496-v12-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpgc8tx6w1, device:0
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-mistral31-24b-s-69496-v12-mkmlizer: Saving flywheel model at /dev/shm/model_cache
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-anthropic-40k-2-11629-v11-mkmlizer: Downloaded to shared memory in 90.040s
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-anthropic-40k-2-11629-v11-mkmlizer: Checking if ChaiML/anthropic_40k_2496_bo8_85w_b4_l1_merged already exists in ChaiML
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-anthropic-40k-2-11629-v11-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpogltxi9a, device:0
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-anthropic-40k-2-11629-v11-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: Downloaded to shared memory in 84.349s
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: Checking if ChaiML/0sw_95p_5ff_rinen0721_dpo_0130_cp3000_v8_merged already exists in ChaiML
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpqa6bcsfh, device:0
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: Saving flywheel model at /dev/shm/model_cache
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for GuardSubmission
platform
unexpected value; permitted: 'guard' (type=value_error.const; given=coreweave/mkml; permitted=('guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: Downloaded to shared memory in 163.123s
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: Checking if ChaiML/exp_grpo_cp312_96ff_b6_r2_less_ff_merged already exists in ChaiML
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp_uv_wtpt, device:0
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
1 validation error for NemoGuardSubmission
platform
unexpected value; permitted: 'nemo_guard' (type=value_error.const; given=coreweave/mkml; permitted=('nemo_guard',))
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name nitral-ai-captain-bmo-12b-v63-mkmlizer
Waiting for job on nitral-ai-captain-bmo-12b-v63-mkmlizer to finish
nitral-ai-captain-bmo-12b-v63-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ Version: 0.29.3 ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ https://mk1.ai ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ The license key for the current software has been verified as ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ belonging to: ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ Chai Research Corp. ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ║ ║
nitral-ai-captain-bmo-12b-v63-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
nitral-ai-captain-bmo-12b-v63-mkmlizer: Downloaded to shared memory in 40.331s
nitral-ai-captain-bmo-12b-v63-mkmlizer: Checking if Nitral-AI/Captain_BMO-12B already exists in ChaiML
nitral-ai-captain-bmo-12b-v63-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp_ln77z3a, device:0
nitral-ai-captain-bmo-12b-v63-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-anthropic-40k-2-11629-v11-mkmlizer: quantized model in 169.588s
chaiml-anthropic-40k-2-11629-v11-mkmlizer: Processed model ChaiML/anthropic_40k_2496_bo8_85w_b4_l1_merged in 259.628s
chaiml-anthropic-40k-2-11629-v11-mkmlizer: creating bucket guanaco-mkml-models
chaiml-anthropic-40k-2-11629-v11-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-anthropic-40k-2-11629-v11-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-anthropic-40k-2-11629-v11
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: creating bucket guanaco-mkml-models
chaiml-anthropic-40k-2-11629-v11-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-anthropic-40k-2-11629-v11/config.json
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-anthropic-40k-2-11629-v11-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-anthropic-40k-2-11629-v11/special_tokens_map.json
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-0sw-95p-5ff-rin-63828-v13
chaiml-anthropic-40k-2-11629-v11-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-anthropic-40k-2-11629-v11/tokenizer_config.json
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-0sw-95p-5ff-rin-63828-v13/config.json
chaiml-anthropic-40k-2-11629-v11-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-anthropic-40k-2-11629-v11/tokenizer.json
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-0sw-95p-5ff-rin-63828-v13/special_tokens_map.json
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-0sw-95p-5ff-rin-63828-v13/tokenizer_config.json
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-0sw-95p-5ff-rin-63828-v13/tokenizer.json
chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-0sw-95p-5ff-rin-63828-v13/flywheel_model.0.safetensors
Job chaiml-anthropic-40k-2-11629-v11-mkmlizer completed after 289.66s with status: succeeded
Stopping job with name chaiml-anthropic-40k-2-11629-v11-mkmlizer
Pipeline stage MKMLizer completed in 293.79s
run pipeline stage %s
Job chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer completed after 322.02s with status: succeeded
Running pipeline stage MKMLTemplater
Stopping job with name chaiml-0sw-95p-5ff-rin-63828-v13-mkmlizer
Pipeline stage MKMLTemplater completed in 1.09s
Pipeline stage MKMLizer completed in 325.72s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.08s
Creating inference service chaiml-anthropic-40k-2-11629-v11
run pipeline stage %s
Waiting for inference service chaiml-anthropic-40k-2-11629-v11 to be ready
Running pipeline stage MKMLDeployer
Creating inference service chaiml-0sw-95p-5ff-rin-63828-v13
Waiting for inference service chaiml-0sw-95p-5ff-rin-63828-v13 to be ready
chaiml-slerpv5-mistral-24540-v19-mkmlizer: quantized model in 330.853s
chaiml-slerpv5-mistral-24540-v19-mkmlizer: Processed model ChaiML/slerpv5_mistral31_simpo_dpo_dpoold_s2 in 400.729s
chaiml-slerpv5-mistral-24540-v19-mkmlizer: creating bucket guanaco-mkml-models
chaiml-slerpv5-mistral-24540-v19-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-slerpv5-mistral-24540-v19-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-slerpv5-mistral-24540-v19
chaiml-slerpv5-mistral-24540-v19-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-slerpv5-mistral-24540-v19/config.json
chaiml-slerpv5-mistral-24540-v19-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-slerpv5-mistral-24540-v19/special_tokens_map.json
chaiml-slerpv5-mistral-24540-v19-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-slerpv5-mistral-24540-v19/tokenizer_config.json
chaiml-slerpv5-mistral-24540-v19-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-slerpv5-mistral-24540-v19/tokenizer.json
Job chaiml-slerpv5-mistral-24540-v19-mkmlizer completed after 430.69s with status: succeeded
Stopping job with name chaiml-slerpv5-mistral-24540-v19-mkmlizer
Pipeline stage MKMLizer completed in 433.39s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.40s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-slerpv5-mistral-24540-v19
Waiting for inference service chaiml-slerpv5-mistral-24540-v19 to be ready
nitral-ai-captain-bmo-12b-v63-mkmlizer: quantized model in 165.604s
nitral-ai-captain-bmo-12b-v63-mkmlizer: Processed model Nitral-AI/Captain_BMO-12B in 206.011s
nitral-ai-captain-bmo-12b-v63-mkmlizer: creating bucket guanaco-mkml-models
nitral-ai-captain-bmo-12b-v63-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
nitral-ai-captain-bmo-12b-v63-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v63
Inference service chaiml-anthropic-40k-2-11629-v11 ready after 111.25869798660278s
Pipeline stage MKMLDeployer completed in 115.74s
run pipeline stage %s
Running pipeline stage StressChecker
chaiml-mistral31-24b-s-69496-v12-mkmlizer: quantized model in 324.823s
chaiml-mistral31-24b-s-69496-v12-mkmlizer: Processed model ChaiML/mistral31-24b-simpoexp1-s1-new-sft-retryv2top20lex-2e in 394.316s
nitral-ai-captain-bmo-12b-v63-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/nitral-ai-captain-bmo-12b-v63/flywheel_model.0.safetensors
chaiml-mistral31-24b-s-69496-v12-mkmlizer: creating bucket guanaco-mkml-models
nitral-ai-captain-bmo-12b-v63-mkmlizer:
Loading 0: 0%| | 0/363 [00:00<?, ?it/s]
Loading 0: 1%| | 2/363 [00:00<00:34, 10.52it/s]
Loading 0: 1%| | 4/363 [00:01<01:57, 3.04it/s]
Loading 0: 1%|▏ | 5/363 [00:02<03:07, 1.91it/s]
Loading 0: 2%|▏ | 6/363 [00:03<04:05, 1.45it/s]
Loading 0: 2%|▏ | 9/363 [00:03<02:11, 2.69it/s]
Loading 0: 3%|▎ | 10/363 [00:03<02:07, 2.77it/s]
Loading 0: 3%|▎ | 11/363 [00:04<01:50, 3.19it/s]
Loading 0: 4%|▎ | 13/363 [00:05<02:14, 2.59it/s]
Loading 0: 4%|▍ | 14/363 [00:06<03:00, 1.93it/s]
Loading 0: 4%|▍ | 15/363 [00:07<03:44, 1.55it/s]
Loading 0: 5%|▍ | 18/363 [00:07<02:10, 2.64it/s]
Loading 0: 5%|▌ | 19/363 [00:07<02:03, 2.78it/s]
Loading 0: 6%|▌ | 20/363 [00:07<01:47, 3.19it/s]
Loading 0: 6%|▌ | 22/363 [00:08<02:10, 2.61it/s]
Loading 0: 6%|▋ | 23/363 [00:09<02:54, 1.95it/s]
Loading 0: 7%|▋ | 24/363 [00:10<03:38, 1.55it/s]
Loading 0: 7%|▋ | 27/363 [00:11<02:07, 2.64it/s]
Loading 0: 8%|▊ | 28/363 [00:11<02:00, 2.77it/s]
Loading 0: 8%|▊ | 29/363 [00:11<01:44, 3.20it/s]
Loading 0: 9%|▊ | 31/363 [00:12<02:06, 2.63it/s]
Loading 0: 9%|▉ | 32/363 [00:13<02:48, 1.97it/s]
Loading 0: 9%|▉ | 33/363 [00:14<03:30, 1.56it/s]
Loading 0: 10%|▉ | 36/363 [00:15<02:03, 2.65it/s]
Loading 0: 10%|█ | 37/363 [00:15<01:57, 2.78it/s]
Loading 0: 10%|█ | 38/363 [00:15<01:41, 3.22it/s]
Loading 0: 11%|█ | 40/363 [00:16<02:13, 2.42it/s]
Loading 0: 11%|█▏ | 41/363 [00:17<02:51, 1.87it/s]
Loading 0: 12%|█▏ | 42/363 [00:18<03:31, 1.52it/s]
Loading 0: 12%|█▏ | 45/363 [00:19<02:02, 2.59it/s]
Loading 0: 13%|█▎ | 46/363 [00:19<01:56, 2.73it/s]
Loading 0: 13%|█▎ | 47/363 [00:19<01:40, 3.16it/s]
Loading 0: 13%|█▎ | 49/363 [00:20<02:00, 2.61it/s]
Loading 0: 14%|█▍ | 50/363 [00:21<02:39, 1.96it/s]
Loading 0: 14%|█▍ | 51/363 [00:22<03:19, 1.57it/s]
Loading 0: 15%|█▍ | 54/363 [00:22<01:56, 2.65it/s]
Loading 0: 15%|█▌ | 55/363 [00:23<01:50, 2.78it/s]
Loading 0: 15%|█▌ | 56/363 [00:23<01:35, 3.22it/s]
Loading 0: 16%|█▌ | 58/363 [00:24<01:55, 2.64it/s]
Loading 0: 16%|█▋ | 59/363 [00:25<02:35, 1.96it/s]
Loading 0: 17%|█▋ | 60/363 [00:26<03:12, 1.57it/s]
Loading 0: 17%|█▋ | 63/363 [00:26<01:52, 2.66it/s]
Loading 0: 18%|█▊ | 64/363 [00:26<01:47, 2.79it/s]
Loading 0: 18%|█▊ | 65/363 [00:27<01:33, 3.19it/s]
Loading 0: 18%|█▊ | 67/363 [00:28<01:52, 2.62it/s]
Loading 0: 19%|█▊ | 68/363 [00:29<02:30, 1.97it/s]
Loading 0: 19%|█▉ | 69/363 [00:30<03:07, 1.57it/s]
Loading 0: 20%|█▉ | 72/363 [00:30<01:49, 2.65it/s]
Loading 0: 20%|██ | 73/363 [00:30<01:44, 2.78it/s]
Loading 0: 20%|██ | 74/363 [00:30<01:30, 3.20it/s]
Loading 0: 21%|██ | 76/363 [00:31<01:49, 2.63it/s]
Loading 0: 21%|██ | 77/363 [00:32<02:25, 1.97it/s]
Loading 0: 21%|██▏ | 78/363 [00:33<03:01, 1.57it/s]
Loading 0: 22%|██▏ | 81/363 [00:34<01:46, 2.66it/s]
Loading 0: 23%|██▎ | 82/363 [00:34<01:40, 2.79it/s]
Loading 0: 23%|██▎ | 83/363 [00:34<01:27, 3.21it/s]
Loading 0: 23%|██▎ | 85/363 [00:35<01:46, 2.62it/s]
Loading 0: 24%|██▎ | 86/363 [00:36<02:21, 1.95it/s]
Loading 0: 24%|██▍ | 87/363 [00:37<02:56, 1.56it/s]
Loading 0: 25%|██▍ | 90/363 [00:38<01:43, 2.64it/s]
Loading 0: 25%|██▌ | 91/363 [00:38<01:38, 2.76it/s]
Loading 0: 25%|██▌ | 92/363 [00:38<01:25, 3.17it/s]
Loading 0: 26%|██▌ | 94/363 [00:39<01:42, 2.61it/s]
Loading 0: 26%|██▌ | 95/363 [00:40<02:16, 1.96it/s]
Loading 0: 26%|██▋ | 96/363 [00:41<02:51, 1.56it/s]
Loading 0: 27%|██▋ | 99/363 [00:41<01:40, 2.63it/s]
Loading 0: 28%|██▊ | 100/363 [00:42<01:35, 2.77it/s]
Loading 0: 28%|██▊ | 101/363 [00:42<01:22, 3.16it/s]
Loading 0: 28%|██▊ | 103/363 [00:43<01:39, 2.61it/s]
Loading 0: 29%|██▊ | 104/363 [00:44<02:12, 1.95it/s]
Loading 0: 29%|██▉ | 105/363 [00:45<02:45, 1.56it/s]
Loading 0: 30%|██▉ | 108/363 [00:45<01:36, 2.64it/s]
Loading 0: 30%|███ | 109/363 [00:45<01:31, 2.77it/s]
Loading 0: 30%|███ | 110/363 [00:46<01:20, 3.16it/s]
Loading 0: 31%|███ | 112/363 [00:47<01:36, 2.59it/s]
Loading 0: 31%|███ | 113/363 [00:48<02:08, 1.94it/s]
Loading 0: 31%|███▏ | 114/363 [00:49<02:39, 1.56it/s]
Loading 0: 32%|███▏ | 117/363 [00:49<01:33, 2.63it/s]
Loading 0: 33%|███▎ | 118/363 [00:49<01:28, 2.77it/s]
Loading 0: 33%|███▎ | 119/363 [00:49<01:16, 3.20it/s]
Loading 0: 33%|███▎ | 121/363 [00:51<01:40, 2.41it/s]
Loading 0: 34%|███▎ | 122/363 [00:52<02:09, 1.86it/s]
Loading 0: 34%|███▍ | 123/363 [00:53<02:38, 1.52it/s]
Loading 0: 35%|███▍ | 126/363 [00:53<01:32, 2.58it/s]
Loading 0: 35%|███▍ | 127/363 [00:53<01:26, 2.72it/s]
Loading 0: 35%|███▌ | 128/363 [00:53<01:15, 3.13it/s]
Loading 0: 36%|███▌ | 130/363 [00:54<01:29, 2.60it/s]
Loading 0: 36%|███▌ | 131/363 [00:55<01:58, 1.95it/s]
Loading 0: 36%|███▋ | 132/363 [00:56<02:29, 1.55it/s]
Loading 0: 37%|███▋ | 135/363 [00:57<01:27, 2.62it/s]
Loading 0: 37%|███▋ | 136/363 [00:57<01:22, 2.75it/s]
Loading 0: 38%|███▊ | 137/363 [00:57<01:11, 3.17it/s]
Loading 0: 38%|███▊ | 139/363 [00:58<01:26, 2.60it/s]
Loading 0: 39%|███▊ | 140/363 [00:59<01:54, 1.95it/s]
Loading 0: 39%|███▉ | 141/363 [01:00<02:21, 1.56it/s]
Loading 0: 40%|███▉ | 144/363 [01:01<01:22, 2.65it/s]
Loading 0: 40%|███▉ | 145/363 [01:01<01:18, 2.78it/s]
Loading 0: 40%|████ | 146/363 [01:01<01:07, 3.19it/s]
Loading 0: 41%|████ | 148/363 [01:02<01:21, 2.62it/s]
Loading 0: 41%|████ | 149/363 [01:03<01:48, 1.97it/s]
Loading 0: 41%|████▏ | 150/363 [01:04<02:15, 1.57it/s]
Loading 0: 42%|████▏ | 153/363 [01:04<01:19, 2.66it/s]
Loading 0: 42%|████▏ | 154/363 [01:05<01:14, 2.79it/s]
Loading 0: 43%|████▎ | 155/363 [01:05<01:04, 3.21it/s]
Loading 0: 43%|████▎ | 157/363 [01:06<01:18, 2.63it/s]
Loading 0: 44%|████▎ | 158/363 [01:07<01:44, 1.96it/s]
Loading 0: 44%|████▍ | 159/363 [01:08<02:10, 1.57it/s]
Loading 0: 45%|████▍ | 162/363 [01:08<01:15, 2.65it/s]
Loading 0: 45%|████▍ | 163/363 [01:09<01:11, 2.79it/s]
Loading 0: 45%|████▌ | 164/363 [01:09<01:02, 3.20it/s]
Loading 0: 46%|████▌ | 166/363 [01:10<01:15, 2.62it/s]
Loading 0: 46%|████▌ | 167/363 [01:11<01:39, 1.97it/s]
Loading 0: 46%|████▋ | 168/363 [01:12<02:03, 1.58it/s]
Loading 0: 47%|████▋ | 171/363 [01:12<01:12, 2.66it/s]
Loading 0: 47%|████▋ | 172/363 [01:12<01:08, 2.80it/s]
Loading 0: 48%|████▊ | 173/363 [01:12<00:59, 3.22it/s]
Loading 0: 48%|████▊ | 175/363 [01:13<01:11, 2.64it/s]
Loading 0: 48%|████▊ | 176/363 [01:14<01:34, 1.98it/s]
Loading 0: 49%|████▉ | 177/363 [01:15<01:57, 1.58it/s]
Loading 0: 50%|████▉ | 180/363 [01:16<01:08, 2.66it/s]
Loading 0: 50%|████▉ | 181/363 [01:16<01:05, 2.79it/s]
Loading 0: 50%|█████ | 182/363 [01:16<00:56, 3.21it/s]
Loading 0: 51%|█████ | 184/363 [01:17<01:08, 2.62it/s]
Loading 0: 51%|█████ | 185/363 [01:18<01:30, 1.96it/s]
Loading 0: 51%|█████ | 186/363 [01:19<01:52, 1.57it/s]
Loading 0: 52%|█████▏ | 189/363 [01:20<01:05, 2.65it/s]
Loading 0: 52%|█████▏ | 190/363 [01:20<01:02, 2.79it/s]
Loading 0: 53%|█████▎ | 191/363 [01:20<00:53, 3.21it/s]
Loading 0: 53%|█████▎ | 193/363 [01:21<01:04, 2.63it/s]
Loading 0: 53%|█████▎ | 194/363 [01:22<01:25, 1.97it/s]
Loading 0: 54%|█████▎ | 195/363 [01:23<01:46, 1.57it/s]
Loading 0: 55%|█████▍ | 198/363 [01:23<01:02, 2.66it/s]
Loading 0: 55%|█████▍ | 199/363 [01:24<00:58, 2.79it/s]
Loading 0: 55%|█████▌ | 200/363 [01:24<00:50, 3.20it/s]
Loading 0: 56%|█████▌ | 202/363 [01:25<01:06, 2.41it/s]
Loading 0: 56%|█████▌ | 203/363 [01:26<01:25, 1.87it/s]
Loading 0: 56%|█████▌ | 204/363 [01:27<01:44, 1.52it/s]
Loading 0: 57%|█████▋ | 207/363 [01:27<01:00, 2.58it/s]
Loading 0: 57%|█████▋ | 208/363 [01:28<00:57, 2.71it/s]
Loading 0: 58%|█████▊ | 209/363 [01:28<00:49, 3.12it/s]
Loading 0: 58%|█████▊ | 211/363 [01:29<00:59, 2.57it/s]
Loading 0: 58%|█████▊ | 212/363 [01:30<01:17, 1.94it/s]
Loading 0: 59%|█████▊ | 213/363 [01:31<01:36, 1.56it/s]
Loading 0: 60%|█████▉ | 216/363 [01:31<00:55, 2.63it/s]
Loading 0: 60%|█████▉ | 217/363 [01:32<00:52, 2.76it/s]
Loading 0: 60%|██████ | 218/363 [01:32<00:45, 3.18it/s]
Loading 0: 61%|██████ | 220/363 [01:33<00:54, 2.62it/s]
Loading 0: 61%|██████ | 221/363 [01:34<01:12, 1.97it/s]
Loading 0: 61%|██████ | 222/363 [01:35<01:29, 1.58it/s]
Loading 0: 62%|██████▏ | 225/363 [01:35<00:51, 2.66it/s]
Loading 0: 62%|██████▏ | 226/363 [01:35<00:49, 2.79it/s]
Loading 0: 63%|██████▎ | 227/363 [01:35<00:42, 3.21it/s]
Loading 0: 63%|██████▎ | 229/363 [01:36<00:51, 2.63it/s]
Loading 0: 63%|██████▎ | 230/363 [01:37<01:07, 1.97it/s]
Loading 0: 64%|██████▎ | 231/363 [01:38<01:24, 1.57it/s]
Loading 0: 64%|██████▍ | 234/363 [01:39<00:48, 2.65it/s]
Loading 0: 65%|██████▍ | 235/363 [01:39<00:45, 2.78it/s]
Loading 0: 65%|██████▌ | 236/363 [01:39<00:39, 3.20it/s]
Loading 0: 66%|██████▌ | 238/363 [01:40<00:47, 2.63it/s]
Loading 0: 66%|██████▌ | 239/363 [01:41<01:02, 1.97it/s]
Loading 0: 66%|██████▌ | 240/363 [01:42<01:18, 1.57it/s]
Loading 0: 67%|██████▋ | 243/363 [01:43<00:45, 2.66it/s]
Loading 0: 67%|██████▋ | 244/363 [01:43<00:42, 2.79it/s]
Loading 0: 67%|██████▋ | 245/363 [01:43<00:36, 3.20it/s]
Loading 0: 68%|██████▊ | 247/363 [01:44<00:44, 2.63it/s]
Loading 0: 68%|██████▊ | 248/363 [01:45<00:58, 1.97it/s]
Loading 0: 69%|██████▊ | 249/363 [01:46<01:12, 1.57it/s]
Loading 0: 69%|██████▉ | 252/363 [01:46<00:41, 2.66it/s]
Loading 0: 70%|██████▉ | 253/363 [01:47<00:39, 2.79it/s]
Loading 0: 70%|██████▉ | 254/363 [01:47<00:34, 3.19it/s]
Loading 0: 71%|███████ | 256/363 [01:48<00:40, 2.63it/s]
Loading 0: 71%|███████ | 257/363 [01:49<00:53, 1.97it/s]
Loading 0: 71%|███████ | 258/363 [01:50<01:06, 1.58it/s]
Loading 0: 72%|███████▏ | 261/363 [01:50<00:38, 2.67it/s]
Loading 0: 72%|███████▏ | 262/363 [01:50<00:36, 2.80it/s]
Loading 0: 72%|███████▏ | 263/363 [01:51<00:31, 3.22it/s]
Loading 0: 73%|███████▎ | 265/363 [01:52<00:37, 2.63it/s]
Loading 0: 73%|███████▎ | 266/363 [01:53<00:49, 1.97it/s]
Loading 0: 74%|███████▎ | 267/363 [01:54<01:00, 1.58it/s]
Loading 0: 74%|███████▍ | 270/363 [01:54<00:35, 2.65it/s]
Loading 0: 75%|███████▍ | 271/363 [01:54<00:33, 2.78it/s]
Loading 0: 75%|███████▍ | 272/363 [01:54<00:28, 3.17it/s]
Loading 0: 75%|███████▌ | 274/363 [01:55<00:34, 2.60it/s]
Loading 0: 76%|███████▌ | 275/363 [01:56<00:45, 1.95it/s]
Loading 0: 76%|███████▌ | 276/363 [01:57<00:55, 1.56it/s]
Loading 0: 77%|███████▋ | 279/363 [01:58<00:31, 2.63it/s]
Loading 0: 77%|███████▋ | 280/363 [01:58<00:30, 2.76it/s]
Loading 0: 77%|███████▋ | 281/363 [01:58<00:25, 3.16it/s]
Loading 0: 78%|███████▊ | 283/363 [01:59<00:33, 2.38it/s]
Loading 0: 78%|███████▊ | 284/363 [02:00<00:42, 1.86it/s]
Loading 0: 79%|███████▊ | 285/363 [02:01<00:51, 1.53it/s]
Loading 0: 79%|███████▉ | 288/363 [02:02<00:28, 2.60it/s]
Loading 0: 80%|███████▉ | 289/363 [02:02<00:26, 2.75it/s]
Loading 0: 80%|███████▉ | 290/363 [02:02<00:23, 3.16it/s]
Loading 0: 80%|████████ | 292/363 [02:03<00:27, 2.62it/s]
Loading 0: 81%|████████ | 293/363 [02:04<00:35, 1.98it/s]
Loading 0: 81%|████████ | 294/363 [02:05<00:43, 1.58it/s]
Loading 0: 82%|████████▏ | 297/363 [02:06<00:24, 2.68it/s]
Loading 0: 82%|████████▏ | 298/363 [02:06<00:23, 2.82it/s]
Loading 0: 82%|████████▏ | 299/363 [02:06<00:19, 3.23it/s]
Loading 0: 83%|████████▎ | 301/363 [02:07<00:23, 2.64it/s]
Loading 0: 83%|████████▎ | 302/363 [02:08<00:30, 1.98it/s]
Loading 0: 83%|████████▎ | 303/363 [02:09<00:37, 1.59it/s]
Loading 0: 84%|████████▍ | 306/363 [02:09<00:21, 2.69it/s]
Loading 0: 85%|████████▍ | 307/363 [02:10<00:19, 2.83it/s]
Loading 0: 85%|████████▍ | 308/363 [02:10<00:17, 3.21it/s]
Loading 0: 85%|████████▌ | 310/363 [02:11<00:19, 2.66it/s]
Loading 0: 86%|████████▌ | 311/363 [02:12<00:25, 2.00it/s]
Loading 0: 86%|████████▌ | 312/363 [02:13<00:31, 1.61it/s]
Loading 0: 87%|████████▋ | 315/363 [02:13<00:17, 2.71it/s]
Loading 0: 87%|████████▋ | 316/363 [02:13<00:16, 2.85it/s]
Loading 0: 87%|████████▋ | 317/363 [02:13<00:14, 3.25it/s]
Loading 0: 88%|████████▊ | 319/363 [02:14<00:16, 2.67it/s]
Loading 0: 88%|████████▊ | 320/363 [02:15<00:21, 2.00it/s]
Loading 0: 88%|████████▊ | 321/363 [02:16<00:26, 1.61it/s]
Loading 0: 89%|████████▉ | 324/363 [02:17<00:14, 2.72it/s]
Loading 0: 90%|████████▉ | 325/363 [02:17<00:13, 2.86it/s]
Loading 0: 90%|████████▉ | 326/363 [02:17<00:11, 3.28it/s]
Loading 0: 90%|█████████ | 328/363 [02:18<00:13, 2.69it/s]
Loading 0: 91%|█████████ | 329/363 [02:19<00:16, 2.01it/s]
Loading 0: 91%|█████████ | 330/363 [02:20<00:20, 1.61it/s]
Loading 0: 92%|█████████▏| 333/363 [02:20<00:11, 2.72it/s]
Loading 0: 92%|█████████▏| 334/363 [02:21<00:10, 2.85it/s]
Loading 0: 92%|█████████▏| 335/363 [02:21<00:08, 3.28it/s]
Loading 0: 93%|█████████▎| 337/363 [02:22<00:09, 2.69it/s]
Loading 0: 93%|█████████▎| 338/363 [02:23<00:12, 2.02it/s]
Loading 0: 93%|█████████▎| 339/363 [02:24<00:14, 1.61it/s]
Loading 0: 94%|█████████▍| 342/363 [02:24<00:07, 2.72it/s]
Loading 0: 94%|█████████▍| 343/363 [02:24<00:07, 2.85it/s]
Loading 0: 95%|█████████▍| 344/363 [02:25<00:05, 3.29it/s]
Loading 0: 95%|█████████▌| 346/363 [02:26<00:06, 2.68it/s]
Loading 0: 96%|█████████▌| 347/363 [02:26<00:07, 2.01it/s]
Loading 0: 96%|█████████▌| 348/363 [02:28<00:09, 1.60it/s]
Loading 0: 97%|█████████▋| 351/363 [02:28<00:04, 2.70it/s]
Loading 0: 97%|█████████▋| 352/363 [02:28<00:03, 2.83it/s]
Loading 0: 97%|█████████▋| 353/363 [02:28<00:03, 3.25it/s]
Loading 0: 98%|█████████▊| 355/363 [02:29<00:03, 2.66it/s]
Loading 0: 98%|█████████▊| 356/363 [02:30<00:03, 1.99it/s]
Loading 0: 98%|█████████▊| 357/363 [02:31<00:03, 1.60it/s]
Loading 0: 99%|█████████▉| 360/363 [02:32<00:01, 2.70it/s]
Loading 0: 99%|█████████▉| 361/363 [02:32<00:00, 2.83it/s]
Loading 0: 100%|█████████▉| 362/363 [02:32<00:00, 3.26it/s]
chaiml-mistral31-24b-s-69496-v12-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
Job nitral-ai-captain-bmo-12b-v63-mkmlizer completed after 231.4s with status: succeeded
HTTP Request: %s %s "%s %d %s"
chaiml-mistral31-24b-s-69496-v12-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral31-24b-s-69496-v12
Stopping job with name nitral-ai-captain-bmo-12b-v63-mkmlizer
Received healthy response to inference request in 5.077281475067139s
chaiml-mistral31-24b-s-69496-v12-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral31-24b-s-69496-v12/config.json
Pipeline stage MKMLizer completed in 237.22s
chaiml-mistral31-24b-s-69496-v12-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral31-24b-s-69496-v12/special_tokens_map.json
run pipeline stage %s
chaiml-mistral31-24b-s-69496-v12-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral31-24b-s-69496-v12/tokenizer_config.json
Running pipeline stage MKMLTemplater
HTTP Request: %s %s "%s %d %s"
chaiml-mistral31-24b-s-69496-v12-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral31-24b-s-69496-v12/tokenizer.json
Pipeline stage MKMLTemplater completed in 1.28s
Inference service chaiml-0sw-95p-5ff-rin-63828-v13 ready after 121.4343249797821s
Received healthy response to inference request in 2.906242609024048s
chaiml-mistral31-24b-s-69496-v12-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral31-24b-s-69496-v12/flywheel_model.1.safetensors
run pipeline stage %s
Pipeline stage MKMLDeployer completed in 126.26s
Running pipeline stage MKMLDeployer
run pipeline stage %s
Creating inference service nitral-ai-captain-bmo-12b-v63
Running pipeline stage StressChecker
HTTP Request: %s %s "%s %d %s"
Waiting for inference service nitral-ai-captain-bmo-12b-v63 to be ready
Received healthy response to inference request in 3.0732996463775635s
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.8417153358459473s
Received healthy response to inference request in 2.7920351028442383s
HTTP Request: %s %s "%s %d %s"
Job chaiml-mistral31-24b-s-69496-v12-mkmlizer completed after 489.62s with status: succeeded
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.5826613903045654s
Stopping job with name chaiml-mistral31-24b-s-69496-v12-mkmlizer
Received healthy response to inference request in 4.2095091342926025s
Pipeline stage MKMLizer completed in 494.58s
5 requests
HTTP Request: %s %s "%s %d %s"
run pipeline stage %s
0 failed requests
Received healthy response to inference request in 3.588353395462036s
Running pipeline stage MKMLTemplater
5th percentile: 2.8148766040802
Pipeline stage MKMLTemplater completed in 2.02s
10th percentile: 2.837718105316162
HTTP Request: %s %s "%s %d %s"
run pipeline stage %s
20th percentile: 2.883401107788086
Received healthy response to inference request in 3.903566360473633s
Running pipeline stage MKMLDeployer
30th percentile: 2.939654016494751
Creating inference service chaiml-mistral31-24b-s-69496-v12
40th percentile: 3.0064768314361574
50th percentile: 3.0732996463775635
Waiting for inference service chaiml-mistral31-24b-s-69496-v12 to be ready
HTTP Request: %s %s "%s %d %s"
60th percentile: 3.527783441543579
Received healthy response to inference request in 3.8146371841430664s
70th percentile: 3.9822672367095944
5 requests
80th percentile: 4.38306360244751
0 failed requests
Inference service chaiml-slerpv5-mistral-24540-v19 ready after 111.39224553108215s
90th percentile: 4.730172538757325
5th percentile: 3.5837997913360597
Pipeline stage MKMLDeployer completed in 116.27s
95th percentile: 4.903727006912232
10th percentile: 3.5849381923675536
run pipeline stage %s
99th percentile: 5.042570581436157
20th percentile: 3.587214994430542
Running pipeline stage StressChecker
mean time: 3.611673593521118
30th percentile: 3.633610153198242
%s, retrying in %s seconds...
40th percentile: 3.7241236686706545
50th percentile: 3.8146371841430664
60th percentile: 3.8254684448242187
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
70th percentile: 3.836299705505371
Received healthy response to inference request in 4.629234552383423s
Received healthy response to inference request in 4.128361463546753s
80th percentile: 3.8540855407714845
90th percentile: 3.8788259506225584
95th percentile: 3.8911961555480956
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
99th percentile: 3.901092319488525
Received healthy response to inference request in 3.6658780574798584s
Received healthy response to inference request in 3.4558420181274414s
mean time: 3.7461867332458496
%s, retrying in %s seconds...
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.4647746086120605s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.4969377517700195s
Received healthy response to inference request in 2.9727184772491455s
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.318922281265259s
Received healthy response to inference request in 4.16315484046936s
Received healthy response to inference request in 3.184446334838867s
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: quantized model in 329.914s
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: Processed model ChaiML/exp_grpo_cp312_96ff_b6_r2_less_ff_merged in 493.037s
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: creating bucket guanaco-mkml-models
Received healthy response to inference request in 3.3399839401245117s
Received healthy response to inference request in 3.0422940254211426s
Received healthy response to inference request in 3.752058982849121s
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
5 requests
5 requests
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-exp-grpo-cp312-9-36146-v5
0 failed requests
0 failed requests
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-exp-grpo-cp312-9-36146-v5/config.json
HTTP Request: %s %s "%s %d %s"
5th percentile: 3.3231346130371096
5th percentile: 3.5049952983856203
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-exp-grpo-cp312-9-36146-v5/special_tokens_map.json
Received healthy response to inference request in 3.6505231857299805s
10th percentile: 3.32734694480896
10th percentile: 3.5452159881591796
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-exp-grpo-cp312-9-36146-v5/tokenizer_config.json
20th percentile: 3.335771608352661
20th percentile: 3.6256573677062987
chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-exp-grpo-cp312-9-36146-v5/tokenizer.json
30th percentile: 3.363155555725098
HTTP Request: %s %s "%s %d %s"
30th percentile: 3.683114242553711
40th percentile: 3.4094987869262696
Received healthy response to inference request in 3.2621848583221436s
40th percentile: 3.717586612701416
50th percentile: 3.4558420181274414
5 requests
50th percentile: 3.752058982849121
60th percentile: 3.4722803115844725
0 failed requests
60th percentile: 3.916497325897217
70th percentile: 3.488718605041504
5th percentile: 2.9866335868835447
70th percentile: 4.080935668945313
80th percentile: 3.623222494125366
10th percentile: 3.0005486965179444
80th percentile: 4.256370782852173
90th percentile: 3.8757919788360597
20th percentile: 3.0283789157867433
90th percentile: 4.442802667617798
95th percentile: 4.002076721191406
30th percentile: 3.0707244873046875
95th percentile: 4.53601861000061
99th percentile: 4.1031045150756835
40th percentile: 3.1275854110717773
Job chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer completed after 580.59s with status: succeeded
99th percentile: 4.6105913639068605
mean time: 3.548009490966797
50th percentile: 3.184446334838867
Stopping job with name chaiml-exp-grpo-cp312-9-36146-v5-mkmlizer
mean time: 3.9350202083587646
Pipeline stage StressChecker completed in 94.53s
60th percentile: 3.2155417442321776
%s, retrying in %s seconds...
Pipeline stage MKMLizer completed in 585.82s
run pipeline stage %s
70th percentile: 3.246637153625488
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
80th percentile: 3.339852523803711
Running pipeline stage MKMLTemplater
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.37s
90th percentile: 3.495187854766846
HTTP Request: %s %s "%s %d %s"
Pipeline stage MKMLTemplater completed in 1.76s
run pipeline stage %s
95th percentile: 3.572855520248413
Received healthy response to inference request in 4.464951753616333s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
99th percentile: 3.634989652633667
Running pipeline stage MKMLDeployer
mean time: 3.2224333763122557
Pipeline stage TriggerMKMLProfilingPipeline completed in 1.76s
Creating inference service chaiml-exp-grpo-cp312-9-36146-v5
HTTP Request: %s %s "%s %d %s"
Pipeline stage StressChecker completed in 92.33s
Shutdown handler de-registered
Waiting for inference service chaiml-exp-grpo-cp312-9-36146-v5 to be ready
Received healthy response to inference request in 4.334810972213745s
run pipeline stage %s
chaiml-anthropic-40k-2_11629_v11 status is now deployed due to DeploymentManager action
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
HTTP Request: %s %s "%s %d %s"
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.31s
HTTP Request: %s %s "%s %d %s"
run pipeline stage %s
HTTP Request: %s %s "%s %d %s"
Running pipeline stage TriggerMKMLProfilingPipeline
Received healthy response to inference request in 3.8987233638763428s
Pipeline stage TriggerMKMLProfilingPipeline completed in 1.47s
Shutdown handler de-registered
chaiml-0sw-95p-5ff-rin_63828_v13 status is now deployed due to DeploymentManager action
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.99127197265625s
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.3098559379577637s
5 requests
0 failed requests
5th percentile: 3.0549887657165526
10th percentile: 3.1187055587768553
20th percentile: 3.246139144897461
30th percentile: 3.4276294231414797
40th percentile: 3.663176393508911
Inference service nitral-ai-captain-bmo-12b-v63 ready after 111.46122097969055s
50th percentile: 3.8987233638763428
Pipeline stage MKMLDeployer completed in 116.12s
60th percentile: 4.073158407211304
run pipeline stage %s
70th percentile: 4.2475934505462645
Running pipeline stage StressChecker
80th percentile: 4.360839128494263
90th percentile: 4.412895441055298
95th percentile: 4.438923597335815
99th percentile: 4.4597461223602295
mean time: 3.799922800064087
HTTP Request: %s %s "%s %d %s"
%s, retrying in %s seconds...
Received healthy response to inference request in 3.9810450077056885s
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.1889760494232178s
Received healthy response to inference request in 2.9471688270568848s
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.1373870372772217s
Received healthy response to inference request in 3.7774784564971924s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.593839168548584s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.5974042415618896s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.6734800338745117s
Inference service chaiml-mistral31-24b-s-69496-v12 ready after 111.39962458610535s
HTTP Request: %s %s "%s %d %s"
5 requests
Pipeline stage MKMLDeployer completed in 117.40s
Received healthy response to inference request in 3.4536006450653076s
0 failed requests
run pipeline stage %s
5th percentile: 2.6097673416137694
Running pipeline stage StressChecker
10th percentile: 2.625695514678955
20th percentile: 2.6575518608093263
HTTP Request: %s %s "%s %d %s"
30th percentile: 2.7282177925109865
Received healthy response to inference request in 3.1723132133483887s
40th percentile: 2.8376933097839356
5 requests
50th percentile: 2.9471688270568848
HTTP Request: %s %s "%s %d %s"
0 failed requests
60th percentile: 3.0232561111450194
Received healthy response to inference request in 3.980635643005371s
5th percentile: 3.1756457805633547
70th percentile: 3.0993433952331544
10th percentile: 3.1789783477783202
80th percentile: 3.3061186313629154
20th percentile: 3.1856434822082518
90th percentile: 3.643581819534302
30th percentile: 3.2419009685516356
HTTP Request: %s %s "%s %d %s"
95th percentile: 3.8123134136199948
40th percentile: 3.3477508068084716
Received healthy response to inference request in 3.822582721710205s
99th percentile: 3.9472986888885497
50th percentile: 3.4536006450653076
mean time: 3.066584014892578
60th percentile: 3.5111220836639405
Pipeline stage StressChecker completed in 35.44s
70th percentile: 3.5686435222625734
run pipeline stage %s
HTTP Request: %s %s "%s %d %s"
80th percentile: 3.63341908454895
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Received healthy response to inference request in 3.677927017211914s
90th percentile: 3.705448770523071
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.83s
95th percentile: 3.741463613510132
run pipeline stage %s
99th percentile: 3.7702754878997804
Running pipeline stage TriggerMKMLProfilingPipeline
mean time: 3.4379545211791993
HTTP Request: %s %s "%s %d %s"
Pipeline stage TriggerMKMLProfilingPipeline completed in 1.11s
Pipeline stage StressChecker completed in 127.21s
Received healthy response to inference request in 4.053741693496704s
Shutdown handler de-registered
run pipeline stage %s
nitral-ai-captain-bmo-12b_v63 status is now deployed due to DeploymentManager action
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
HTTP Request: %s %s "%s %d %s"
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.06s
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
run pipeline stage %s
Received healthy response to inference request in 3.725126266479492s
Running pipeline stage TriggerMKMLProfilingPipeline
5 requests
Pipeline stage TriggerMKMLProfilingPipeline completed in 1.09s
0 failed requests
Shutdown handler de-registered
chaiml-slerpv5-mistral_24540_v19 status is now deployed due to DeploymentManager action
10th percentile: 3.696806716918945
HTTP Request: %s %s "%s %d %s"
20th percentile: 3.7156864166259767
30th percentile: 3.744617557525635
HTTP Request: %s %s "%s %d %s"
40th percentile: 3.7836001396179197
50th percentile: 3.822582721710205
60th percentile: 3.8858038902282717
70th percentile: 3.949025058746338
80th percentile: 3.995256853103638
90th percentile: 4.0244992733001705
95th percentile: 4.039120483398437
99th percentile: 4.050817451477051
mean time: 3.852002668380737
%s, retrying in %s seconds...
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.8304970264434814s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.1448493003845215s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.9713077545166016s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.6420698165893555s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.750124216079712s
5 requests
0 failed requests
5th percentile: 2.6636806964874267
10th percentile: 2.685291576385498
20th percentile: 2.7285133361816407
30th percentile: 2.7661987781524657
40th percentile: 2.798347902297974
50th percentile: 2.8304970264434814
60th percentile: 2.8868213176727293
70th percentile: 2.9431456089019776
80th percentile: 3.0060160636901854
90th percentile: 3.0754326820373534
95th percentile: 3.1101409912109377
99th percentile: 3.137907638549805
mean time: 2.8677696228027343
Pipeline stage StressChecker completed in 58.97s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.69s
Shutdown handler de-registered
chaiml-mistral31-24b-s_69496_v12 status is now deployed due to DeploymentManager action
chaiml-mistral31-24b-s_69496_v12 status is now inactive due to auto deactivation removed underperforming models
chaiml-mistral31-24b-s_69496_v12 status is now protected due to ABTestQueueItem
chaiml-mistral31-24b-s_69496_v12 status is now inactive
chaiml-mistral31-24b-s_69496_v12 status is now torndown due to DeploymentManager action