chaiml-q235b-kimid-judg_53083

developer_uid: rirv938
submission_id: chaiml-q235b-kimid-judg_53083_v1
model_name: chaiml-q235b-kimid-judg_53083_v1
model_group: ChaiML/q235b_kimid_judge
status: inactive
timestamp: 2026-04-01T15:57:31+00:00
num_battles: 11481
num_wins: 6447
celo_rating: 8400.31
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/q235b_kimid_judge_dpo-step214-merged
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 1821417132032.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-q235b-kimid-judg_53083_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/q235b_kimid_judge_dpo-step214-merged
model_size: 1821B
ranking_group: single
us_pacific_date: 2026-04-01
win_ratio: 0.5615364515286125
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', '</think>', '####', '<|assistant|>', '<|user|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-q235b-kimid-judg-53083-v1-uploader
Waiting for job on chaiml-q235b-kimid-judg-53083-v1-uploader to finish
chaiml-q235b-kimid-judg-53083-v1-uploader: Using quantization_mode: w4a16
chaiml-q235b-kimid-judg-53083-v1-uploader: Checking if ChaiML/q235b_kimid_judge_dpo-step214-merged-W4A16 already exists in ChaiML
chaiml-q235b-kimid-judg-53083-v1-uploader: Downloading snapshot of ChaiML/q235b_kimid_judge_dpo-step214-merged...
2026-04-01T14:02:24.827280+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
2026-04-01T14:03:24.909842+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
2026-04-01T14:04:25.010086+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: Downloaded in 180.238s
chaiml-q235b-kimid-judg-53083-v1-uploader: Applying quantization...
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:05:08 INFO __init__.py L202: Patched transformers.models.qwen3_moe.modeling_qwen3_moe.Qwen3MoeSparseMoeBlock -> auto_round.modeling.unfused_moe.qwen3_moe.LinearQwen3MoeSparseMoeBlock[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:05:25 INFO base.py L448: `enable_opt_rtn` is turned on, set `--disable_opt_rtn` for higher speed at the cost of accuracy.[0m
2026-04-01T14:05:25.841497+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:05:25 INFO base.py L486: using torch.bfloat16 for quantization tuning[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:05:26 INFO base.py L1573: Using predefined ignore_layers: ['mlp.gate'][0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:05:29 INFO base.py L1081: start to compute imatrix[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
chaiml-q235b-kimid-judg-53083-v1-uploader: [33;1m2026-04-01 14:06:03 WARNING base.py L1201: MoE layer detected: optimized RTN is disabled for efficiency. Use `--enable_opt_rtn` to force-enable it for MoE layers.[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:06:05 INFO device.py L1468:  'peak_ram': 19.08GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:06:18 INFO device.py L1468:  'peak_ram': 20.34GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:06:31.239583+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:06:30 INFO device.py L1468:  'peak_ram': 21.65GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:06:48 INFO device.py L1468:  'peak_ram': 27.1GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:06:59 INFO device.py L1468:  'peak_ram': 27.1GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:07:11 INFO device.py L1468:  'peak_ram': 27.1GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:07:23 INFO device.py L1468:  'peak_ram': 27.1GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:07:31.373187+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:07:39 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:07:51 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:08:03 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:08:17 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:08:31.478577+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:08:33 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
Retrying (%r) after connection broken by '%r': %s
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:08:45 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:08:59 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:09:11 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:09:21 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:09:31.568542+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:09:30 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:09:39 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:09:46 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:09:57 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:10:14 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:10:21 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:10:31.657732+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:10:50 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:11:00 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:11:06 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:11:13 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:11:29 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:11:35 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:11:48.992173+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:11:41 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:11:48 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:11:57 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:12:04 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:12:10 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:12:17 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:12:26 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:12:32 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:12:39 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:12:49.158797+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:12:48 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:12:55 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:13:01 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:13:08 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:13:17 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:13:23 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:13:30 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:13:36 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:13:49.257199+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:13:46 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:13:52 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:13:58 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:14:05 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:14:14 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:14:20 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:14:27 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:14:33 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:14:42 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:14:49.861698+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:14:49 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:14:55 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:15:02 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:15:11 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:15:17 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:15:24 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:15:30 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:15:40 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:15:50.042818+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:15:46 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:15:52 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:15:59 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:16:08 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:16:14 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:16:21 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:16:27 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:16:36 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:16:43 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:16:50.176372+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:16:49 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:16:55 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:17:05 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:17:11 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:17:17 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:17:27 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:17:33 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:17:39 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:17:46 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:17:50.346602+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:17:55 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:18:01 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:18:08 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:18:14 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:18:23 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:18:36 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:18:50.457043+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:18:43 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:18:52 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:18:55 INFO shard_writer.py L208: model has been saved to /dev/shm/model_output/[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [33;1m2026-04-01 14:18:55 WARNING export.py L336: /dev/shm/model_output already exists, this may cause model conflict[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: [38;20m2026-04-01 14:18:55 INFO device.py L1468:  'peak_ram': 27.97GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-53083-v1-uploader: Checking if ChaiML/q235b_kimid_judge_dpo-step214-merged-W4A16 already exists in ChaiML
chaiml-q235b-kimid-judg-53083-v1-uploader: Creating repo ChaiML/q235b_kimid_judge_dpo-step214-merged-W4A16 and uploading /dev/shm/model_output to it
chaiml-q235b-kimid-judg-53083-v1-uploader: ---------- 2026-04-01 14:18:56 (0:00:00) ----------
chaiml-q235b-kimid-judg-53083-v1-uploader: Files:   hashed 7/32 (21.5M/131.9G) | pre-uploaded: 0/1 (0.0/131.9G) (+28 unsure) | committed: 0/32 (0.0/131.9G) | ignored: 0
chaiml-q235b-kimid-judg-53083-v1-uploader: Workers: hashing: 25 | get upload mode: 1 | pre-uploading: 1 | committing: 0 | waiting: 37
chaiml-q235b-kimid-judg-53083-v1-uploader: ---------------------------------------------------
2026-04-01T14:19:50.563496+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: 
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
chaiml-q235b-kimid-judg-53083-v1-uploader: ---------- 2026-04-01 14:19:56 (0:01:00) ----------
chaiml-q235b-kimid-judg-53083-v1-uploader: Files:   hashed 32/32 (131.9G/131.9G) | pre-uploaded: 9/26 (40.6G/131.9G) | committed: 0/32 (0.0/131.9G) | ignored: 0
chaiml-q235b-kimid-judg-53083-v1-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 17 | committing: 0 | waiting: 47
chaiml-q235b-kimid-judg-53083-v1-uploader: ---------------------------------------------------
2026-04-01T14:20:50.671972+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader:                              
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
chaiml-q235b-kimid-judg-53083-v1-uploader: ---------- 2026-04-01 14:20:56 (0:02:00) ----------
chaiml-q235b-kimid-judg-53083-v1-uploader: Files:   hashed 32/32 (131.9G/131.9G) | pre-uploaded: 26/26 (131.9G/131.9G) | committed: 0/32 (0.0/131.9G) | ignored: 0
chaiml-q235b-kimid-judg-53083-v1-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 0 | committing: 1 | waiting: 63
chaiml-q235b-kimid-judg-53083-v1-uploader: ---------------------------------------------------
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
chaiml-q235b-kimid-judg-53083-v1-uploader:                              Processed model ChaiML/q235b_kimid_judge_dpo-step214-merged in 1156.517s
chaiml-q235b-kimid-judg-53083-v1-uploader: creating bucket guanaco-vllm-models
chaiml-q235b-kimid-judg-53083-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-53083-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-q235b-kimid-judg-53083-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-q235b-kimid-judg-53083-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-q235b-kimid-judg-53083-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-53083-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-q235b-kimid-judg-53083-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-53083-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-q235b-kimid-judg-53083-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-53083-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-q235b-kimid-judg-53083-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-53083-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-q235b-kimid-judg-53083-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-q235b-kimid-judg-53083-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-q235b-kimid-judg-53083-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-q235b-kimid-judg-53083-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-q235b-kimid-judg-53083-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-q235b-kimid-judg-53083-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/generation_config.json
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/config.json
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/quantization_config.json
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/tokenizer_config.json
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/chat_template.jinja
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/tokenizer.json
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model.safetensors.index.json
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00025-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00025-of-00025.safetensors
2026-04-01T14:21:50.803783+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00021-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00021-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00005-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00005-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00012-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00012-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00008-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00008-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00015-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00015-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00019-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00019-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00016-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00016-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00007-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00007-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00014-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00014-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00006-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00006-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00001-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00001-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00002-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00002-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00010-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00010-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00022-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00022-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00003-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00003-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00011-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00011-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00024-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00024-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00009-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00009-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00020-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00020-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00004-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00004-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00017-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00017-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00018-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00018-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00013-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00013-of-00025.safetensors
chaiml-q235b-kimid-judg-53083-v1-uploader: cp /dev/shm/model_output/model-00023-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-53083-v1/default/model-00023-of-00025.safetensors
Job chaiml-q235b-kimid-judg-53083-v1-uploader completed after 1244.11s with status: succeeded
Stopping job with name chaiml-q235b-kimid-judg-53083-v1-uploader
Pipeline stage VLLMUploader completed in 1244.99s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.17s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.35s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-q235b-kimid-judg-53083-v1
Waiting for inference service chaiml-q235b-kimid-judg-53083-v1 to be ready
2026-04-01T14:22:50.921588+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
Retrying (%r) after connection broken by '%r': %s
2026-04-01T14:23:51.044315+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
2026-04-01T14:24:51.188549+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
2026-04-01T14:25:51.319285+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
Inference service chaiml-q235b-kimid-judg-53083-v1 ready after 231.16840267181396s
Pipeline stage VLLMDeployer completed in 231.81s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.570204257965088s
Received healthy response to inference request in 1.797398567199707s
Received healthy response to inference request in 3.6399455070495605s
Received healthy response to inference request in 1.784972906112671s
Received healthy response to inference request in 1.6134517192840576s
Received healthy response to inference request in 3.5343494415283203s
Received healthy response to inference request in 1.5448009967803955s
Received healthy response to inference request in 1.5433523654937744s
Received healthy response to inference request in 1.4971277713775635s
Received healthy response to inference request in 3.489884853363037s
Received healthy response to inference request in 2.0080442428588867s
Received healthy response to inference request in 1.9247639179229736s
Received healthy response to inference request in 2.517808675765991s
Received healthy response to inference request in 1.4995379447937012s
Received healthy response to inference request in 1.7453713417053223s
Received healthy response to inference request in 1.4972398281097412s
Received healthy response to inference request in 1.459068775177002s
Received healthy response to inference request in 1.7068336009979248s
Received healthy response to inference request in 1.8097202777862549s
Received healthy response to inference request in 1.4509639739990234s
Received healthy response to inference request in 1.9295217990875244s
2026-04-01T14:26:51.523335+00:00 monitor updated for chaiml-q235b-kimid-judg_53083_v1
Received healthy response to inference request in 1.4829990863800049s
Received healthy response to inference request in 1.760833978652954s
Received healthy response to inference request in 1.8711867332458496s
Received healthy response to inference request in 1.4993202686309814s
Received healthy response to inference request in 1.56581449508667s
Received healthy response to inference request in 1.5640475749969482s
Received healthy response to inference request in 1.4365143775939941s
Received healthy response to inference request in 1.591428518295288s
Received healthy response to inference request in 1.485673427581787s
30 requests
0 failed requests
5th percentile: 1.4546111345291137
10th percentile: 1.4806060552597047
20th percentile: 1.4972174167633057
30th percentile: 1.5302080392837525
40th percentile: 1.5651077270507812
50th percentile: 1.6601426601409912
60th percentile: 1.7704895496368407
70th percentile: 1.8281602144241331
80th percentile: 1.9452262878417972
90th percentile: 3.4943313121795656
95th percentile: 3.554069590568542
99th percentile: 3.6197205448150633
mean time: 1.9274060408274332
Pipeline stage StressChecker completed in 64.51s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.83s
Shutdown handler de-registered
chaiml-q235b-kimid-judg_53083_v1 status is now deployed due to DeploymentManager action
chaiml-q235b-kimid-judg_53083_v1 status is now inactive due to auto deactivation removed underperforming models