developer_uid: rirv938
submission_id: chaiml-q235b-kimid-judg_35787_v4
model_name: chaiml-q235b-kimid-judg_35787_v4
model_group: ChaiML/q235b_kimid_judge
status: inactive
timestamp: 2026-04-03T11:17:07+00:00
num_battles: 10496
num_wins: 5917
celo_rating: 1349.67
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/q235b_kimid_judge_dpo_v2-step416-merged
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 1821417132032.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-q235b-kimid-judg_35787_v4
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/q235b_kimid_judge_dpo_v2-step416-merged
model_size: 1821B
ranking_group: single
us_pacific_date: 2026-04-03
win_ratio: 0.5637385670731707
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', '</think>', '####', '<|user|>', '<|assistant|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-q235b-kimid-judg-35787-v4-uploader
Waiting for job on chaiml-q235b-kimid-judg-35787-v4-uploader to finish
chaiml-q235b-kimid-judg-35787-v4-uploader: Using quantization_mode: w4a16
chaiml-q235b-kimid-judg-35787-v4-uploader: Checking if ChaiML/q235b_kimid_judge_dpo_v2-step416-merged-W4A16 already exists in ChaiML
chaiml-q235b-kimid-judg-35787-v4-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-q235b-kimid-judg-35787-v4-uploader: Downloading snapshot of ChaiML/q235b_kimid_judge_dpo_v2-step416-merged-W4A16...
2026-04-03T05:22:51.718293+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v4
chaiml-q235b-kimid-judg-35787-v4-uploader: creating bucket guanaco-vllm-models
chaiml-q235b-kimid-judg-35787-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-35787-v4-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-q235b-kimid-judg-35787-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-q235b-kimid-judg-35787-v4-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-q235b-kimid-judg-35787-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-35787-v4-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-q235b-kimid-judg-35787-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-35787-v4-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-q235b-kimid-judg-35787-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-35787-v4-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-q235b-kimid-judg-35787-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-35787-v4-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-q235b-kimid-judg-35787-v4-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-q235b-kimid-judg-35787-v4-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-q235b-kimid-judg-35787-v4-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-q235b-kimid-judg-35787-v4-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-q235b-kimid-judg-35787-v4-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-q235b-kimid-judg-35787-v4-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/quantization_config.json
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/config.json
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/.gitattributes
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/tokenizer_config.json
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/chat_template.jinja
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model.safetensors.index.json
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/generation_config.json
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/tokenizer.json
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00025-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00025-of-00025.safetensors
2026-04-03T05:23:51.815807+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v4
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00021-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00021-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00010-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00010-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00024-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00024-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00020-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00020-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00014-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00014-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00003-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00003-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00008-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00008-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00023-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00023-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00011-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00011-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00005-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00005-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00019-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00019-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00013-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00013-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00018-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00018-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00004-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00004-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00015-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00015-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00017-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00017-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00022-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00022-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00012-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00012-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00007-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00007-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00009-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00009-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00001-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00001-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00002-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00002-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00016-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00016-of-00025.safetensors
chaiml-q235b-kimid-judg-35787-v4-uploader: cp /dev/shm/model_output/model-00006-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-35787-v4/default/model-00006-of-00025.safetensors
Job chaiml-q235b-kimid-judg-35787-v4-uploader completed after 134.74s with status: succeeded
Stopping job with name chaiml-q235b-kimid-judg-35787-v4-uploader
Pipeline stage VLLMUploader completed in 135.21s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.09s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.70s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-q235b-kimid-judg-35787-v4
Waiting for inference service chaiml-q235b-kimid-judg-35787-v4 to be ready
2026-04-03T05:24:51.932535+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v4
2026-04-03T05:25:52.088542+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v4
2026-04-03T05:26:52.193228+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v4
Inference service chaiml-q235b-kimid-judg-35787-v4 ready after 210.94600439071655s
Pipeline stage VLLMDeployer completed in 211.47s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.459899425506592s
Received healthy response to inference request in 3.440791606903076s
Received healthy response to inference request in 1.5895371437072754s
2026-04-03T05:27:52.379533+00:00 monitor updated for chaiml-q235b-kimid-judg_35787_v4
Received healthy response to inference request in 3.561582088470459s
Received healthy response to inference request in 1.8040595054626465s
Received healthy response to inference request in 3.4817864894866943s
Received healthy response to inference request in 1.5238969326019287s
Received healthy response to inference request in 1.6025168895721436s
Received healthy response to inference request in 1.5648117065429688s
Received healthy response to inference request in 1.4392554759979248s
Received healthy response to inference request in 1.562856674194336s
Received healthy response to inference request in 3.48209810256958s
Received healthy response to inference request in 1.454422950744629s
Received healthy response to inference request in 1.7918140888214111s
Received healthy response to inference request in 1.7277350425720215s
Received healthy response to inference request in 1.5110902786254883s
Received healthy response to inference request in 1.478724479675293s
Received healthy response to inference request in 1.6928975582122803s
Received healthy response to inference request in 1.538881778717041s
Received healthy response to inference request in 1.7043156623840332s
Received healthy response to inference request in 1.757110357284546s
Received healthy response to inference request in 1.7978465557098389s
Received healthy response to inference request in 1.5560667514801025s
Received healthy response to inference request in 1.6402764320373535s
Received healthy response to inference request in 1.706139326095581s
Received healthy response to inference request in 1.5923936367034912s
Received healthy response to inference request in 1.5051822662353516s
Received healthy response to inference request in 1.5271580219268799s
Received healthy response to inference request in 1.5558972358703613s
Received healthy response to inference request in 1.851487398147583s
30 requests
0 failed requests
5th percentile: 1.4653586387634276
10th percentile: 1.5025364875793457
20th percentile: 1.5265058040618897
30th percentile: 1.5560158967971802
40th percentile: 1.5796469688415529
50th percentile: 1.6213966608047485
60th percentile: 1.7050451278686523
70th percentile: 1.7675214767456053
80th percentile: 1.8135450839996339
90th percentile: 3.462088131904602
95th percentile: 3.4819578766822814
99th percentile: 3.5385317325592043
mean time: 1.9300843954086304
Pipeline stage StressChecker completed in 60.81s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.78s
Shutdown handler de-registered
chaiml-q235b-kimid-judg_35787_v4 status is now deployed due to DeploymentManager action
chaiml-q235b-kimid-judg_35787_v4 status is now inactive due to auto deactivation removed underperforming models