developer_uid: rirv938
submission_id: chaiml-q235b-kimid-judg_35787_v3
model_name: chaiml-q235b-kimid-judg_35787_v3
model_group: ChaiML/q235b_kimid_judge
status: torndown
timestamp: 2026-04-06T01:22:12+00:00
num_battles: 10864
num_wins: 5989
celo_rating: 1341.23
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/q235b_kimid_judge_dpo_v2-step416-merged
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 1821417132032.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-q235b-kimid-judg_35787_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/q235b_kimid_judge_dpo_v2-step416-merged
model_size: 1821B
ranking_group: single
us_pacific_date: 2026-04-02
win_ratio: 0.5512702503681886
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '</think>', '####', '<|user|>', '<|im_end|>', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-q235b-kimid-judg-35787-v3-uploader
Waiting for job on chaiml-q235b-kimid-judg-35787-v3-uploader to finish
chaiml-q235b-kimid-judg-35787-v3-uploader: Using quantization_mode: w4a16
chaiml-q235b-kimid-judg-35787-v3-uploader: Checking if ChaiML/q235b_kimid_judge_dpo_v2-step416-merged-W4A16 already exists in ChaiML
chaiml-q235b-kimid-judg-35787-v3-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-q235b-kimid-judg-35787-v3-uploader: Downloading snapshot of ChaiML/q235b_kimid_judge_dpo_v2-step416-merged-W4A16...
2026-04-02T22:17:32.479552+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v3
chaiml-q235b-kimid-judg-35787-v3-uploader: Downloaded in 55.953s
chaiml-q235b-kimid-judg-35787-v3-uploader: Processed model ChaiML/q235b_kimid_judge_dpo_v2-step416-merged in 58.672s
chaiml-q235b-kimid-judg-35787-v3-uploader: creating bucket guanaco-vllm-models
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/chat_template.jinja
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/config.json
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/tokenizer_config.json
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/quantization_config.json
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/.gitattributes
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/generation_config.json
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model.safetensors.index.json
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/tokenizer.json
2026-04-02T22:18:32.562605+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v3
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00025-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00025-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00010-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00010-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00009-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00009-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00016-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00016-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00023-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00023-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00012-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00012-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00008-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00008-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00018-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00018-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00002-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00002-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00021-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00021-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00014-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00014-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00007-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00007-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00024-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00024-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00022-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00022-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00015-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00015-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00005-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00005-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00011-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00011-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00019-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00019-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00004-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00004-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00020-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00020-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00001-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00001-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00006-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00006-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00003-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00003-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v3-uploader: cp /dev/shm/model_output/model-00017-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v3/default/model-00017-of-00025.safetensors
Job chaiml-q235b-kimid-judg-35787-v3-uploader completed after 153.98s with status: succeeded
Stopping job with name chaiml-q235b-kimid-judg-35787-v3-uploader
Pipeline stage VLLMUploader completed in 154.49s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.08s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.21s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-q235b-kimid-judg-35787-v3
Waiting for inference service chaiml-q235b-kimid-judg-35787-v3 to be ready
2026-04-02T22:19:32.643310+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v3
2026-04-02T22:20:32.778096+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v3
2026-04-02T22:21:32.869268+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v3
2026-04-02T22:22:32.959825+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v3
Inference service chaiml-q235b-kimid-judg-35787-v3 ready after 220.67290663719177s
Pipeline stage VLLMDeployer completed in 221.17s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.272240161895752s
Received healthy response to inference request in 3.4686622619628906s
Received healthy response to inference request in 1.4556128978729248s
Received healthy response to inference request in 1.6598637104034424s
Received healthy response to inference request in 1.5896687507629395s
Received healthy response to inference request in 1.7255539894104004s
Received healthy response to inference request in 1.543567419052124s
Received healthy response to inference request in 4.010867118835449s
Received healthy response to inference request in 1.7355313301086426s
Received healthy response to inference request in 1.5301871299743652s
Received healthy response to inference request in 1.8761777877807617s
Received healthy response to inference request in 1.574664831161499s
Received healthy response to inference request in 1.939403772354126s
Received healthy response to inference request in 1.5388586521148682s
Received healthy response to inference request in 1.541283130645752s
Received healthy response to inference request in 1.5716187953948975s
Received healthy response to inference request in 1.6346125602722168s
Received healthy response to inference request in 1.5078938007354736s
Received healthy response to inference request in 1.5580427646636963s
Received healthy response to inference request in 1.4544777870178223s
Received healthy response to inference request in 1.5070037841796875s
2026-04-02T22:23:33.050742+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v3
Received healthy response to inference request in 1.482081413269043s
Received healthy response to inference request in 1.490140676498413s
Received healthy response to inference request in 1.639064073562622s
Received healthy response to inference request in 1.7359521389007568s
Received healthy response to inference request in 1.46146559715271s
Received healthy response to inference request in 1.4477853775024414s
Received healthy response to inference request in 1.498730182647705s
Received healthy response to inference request in 1.6493706703186035s
Received healthy response to inference request in 2.376019239425659s
30 requests
0 failed requests
5th percentile: 1.4549885869026185
10th percentile: 1.4608803272247315
20th percentile: 1.4970122814178466
30th percentile: 1.5234991312026978
40th percentile: 1.542653703689575
50th percentile: 1.5731418132781982
60th percentile: 1.636393165588379
70th percentile: 1.6795707941055296
80th percentile: 1.7639972686767582
90th percentile: 2.485283541679384
95th percentile: 3.7668749332427964
99th percentile: 4.196441979408265
mean time: 1.8492133935292563
Pipeline stage StressChecker completed in 58.09s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.34s
Shutdown handler de-registered
chaiml-q235b-kimid-judg_35787_v3 status is now deployed due to DeploymentManager action
chaiml-q235b-kimid-judg_35787_v3 status is now inactive due to auto deactivation removed underperforming models
chaiml-q235b-kimid-judg_35787_v3 status is now torndown due to DeploymentManager action