chaiml-q235b-kimid-judg_34515

developer_uid: rirv938
submission_id: chaiml-q235b-kimid-judg_34515_v1
model_name: chaiml-q235b-kimid-judg_34515_v1
model_group: ChaiML/q235b_kimid_judge
status: inactive
timestamp: 2026-04-01T15:57:31+00:00
num_battles: 11658
num_wins: 6482
celo_rating: 8400.31
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/q235b_kimid_judge_dpo-step428-merged
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 1821417132032.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-q235b-kimid-judg_34515_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/q235b_kimid_judge_dpo-step428-merged
model_size: 1821B
ranking_group: single
us_pacific_date: 2026-04-01
win_ratio: 0.5560130382569909
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</think>', '<|im_end|>', '<|user|>', '####', '</s>', '<|assistant|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-q235b-kimid-judg-34515-v1-uploader
Waiting for job on chaiml-q235b-kimid-judg-34515-v1-uploader to finish
chaiml-q235b-kimid-judg-34515-v1-uploader: Using quantization_mode: w4a16
chaiml-q235b-kimid-judg-34515-v1-uploader: Checking if ChaiML/q235b_kimid_judge_dpo-step428-merged-W4A16 already exists in ChaiML
chaiml-q235b-kimid-judg-34515-v1-uploader: Downloading snapshot of ChaiML/q235b_kimid_judge_dpo-step428-merged...
2026-04-01T14:02:28.976174+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
2026-04-01T14:03:29.063523+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
2026-04-01T14:04:29.144044+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
Failed to get response for submission chaiml-qwen-bobo-dpo-ju_56781_v7: ('http://chaiml-qwen-bobo-dpo-ju-56781-v7-predictor.tenant-chaiml-guanaco.k2.chaiverse.com/v1/completions', 'request timeout')
Retrying (%r) after connection broken by '%r': %s
2026-04-01T14:05:29.225188+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: Downloaded in 187.934s
chaiml-q235b-kimid-judg-34515-v1-uploader: Applying quantization...
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:05:23 INFO __init__.py L202: Patched transformers.models.qwen3_moe.modeling_qwen3_moe.Qwen3MoeSparseMoeBlock -> auto_round.modeling.unfused_moe.qwen3_moe.LinearQwen3MoeSparseMoeBlock[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:05:38 INFO base.py L448: `enable_opt_rtn` is turned on, set `--disable_opt_rtn` for higher speed at the cost of accuracy.[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:05:38 INFO base.py L486: using torch.bfloat16 for quantization tuning[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:05:38 INFO base.py L1573: Using predefined ignore_layers: ['mlp.gate'][0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:05:41 INFO base.py L1081: start to compute imatrix[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
chaiml-q235b-kimid-judg-34515-v1-uploader: [33;1m2026-04-01 14:06:17 WARNING base.py L1201: MoE layer detected: optimized RTN is disabled for efficiency. Use `--enable_opt_rtn` to force-enable it for MoE layers.[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:06:19 INFO device.py L1468:  'peak_ram': 19.16GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:06:31.681238+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:06:32 INFO device.py L1468:  'peak_ram': 20.42GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:06:44 INFO device.py L1468:  'peak_ram': 21.78GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:07:02 INFO device.py L1468:  'peak_ram': 27.19GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:07:14 INFO device.py L1468:  'peak_ram': 27.19GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:07:31.841256+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:07:26 INFO device.py L1468:  'peak_ram': 27.19GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:07:39 INFO device.py L1468:  'peak_ram': 27.19GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:07:55 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:08:05 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:08:16 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:08:31.937928+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:08:29 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:08:44 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:09:09 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:09:23 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:09:32.492041+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:09:39 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:09:49 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:09:59 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:10:09 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:10:21 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:10:32.616592+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:10:51 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:11:04 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:11:11 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:11:17 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:11:23 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:11:33 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:11:44.078031+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:11:40 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:11:46 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:11:53 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:12:03 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:12:09 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:12:16 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:12:22 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:12:32 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:12:44.176522+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:12:38 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:12:44 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:12:51 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:13:00 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:13:07 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:13:13 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:13:22 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:13:29 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:13:35 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:13:44.288200+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:13:41 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:13:51 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:14:04 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:14:10 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:14:19 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:14:26 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:14:32 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:14:44.404342+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:14:38 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:14:48 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:14:54 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:15:01 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:15:07 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:15:17 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:15:23 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:15:29 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:15:35 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:15:44.507230+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:15:45 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:15:51 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:15:58 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:16:04 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:16:13 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:16:20 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:16:26 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:16:32 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:16:44.743684+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:16:48 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:16:54 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:17:01 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:17:10 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:17:16 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:17:23 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:17:29 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:17:38 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:17:44.848264+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:17:44 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:17:51 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:18:00 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:18:06 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:18:13 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:18:19 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:18:28 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
2026-04-01T14:18:44.954710+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:18:41 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:18:47 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:18:57 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:19:03 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:19:09 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:19:25 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:19:28 INFO shard_writer.py L208: model has been saved to /dev/shm/model_output/[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [33;1m2026-04-01 14:19:28 WARNING export.py L336: /dev/shm/model_output already exists, this may cause model conflict[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: [38;20m2026-04-01 14:19:29 INFO device.py L1468:  'peak_ram': 28.04GB, 'peak_vram': 11.38GB[0m
chaiml-q235b-kimid-judg-34515-v1-uploader: Checking if ChaiML/q235b_kimid_judge_dpo-step428-merged-W4A16 already exists in ChaiML
chaiml-q235b-kimid-judg-34515-v1-uploader: Creating repo ChaiML/q235b_kimid_judge_dpo-step428-merged-W4A16 and uploading /dev/shm/model_output to it
chaiml-q235b-kimid-judg-34515-v1-uploader: ---------- 2026-04-01 14:19:29 (0:00:00) ----------
chaiml-q235b-kimid-judg-34515-v1-uploader: Files:   hashed 7/32 (21.5M/131.9G) | pre-uploaded: 0/0 (0.0/131.9G) (+31 unsure) | committed: 0/32 (0.0/131.9G) | ignored: 0
chaiml-q235b-kimid-judg-34515-v1-uploader: Workers: hashing: 25 | get upload mode: 1 | pre-uploading: 0 | committing: 0 | waiting: 38
chaiml-q235b-kimid-judg-34515-v1-uploader: ---------------------------------------------------
2026-04-01T14:19:45.055960+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader: 
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
chaiml-q235b-kimid-judg-34515-v1-uploader: ---------- 2026-04-01 14:20:29 (0:01:00) ----------
chaiml-q235b-kimid-judg-34515-v1-uploader: Files:   hashed 32/32 (131.9G/131.9G) | pre-uploaded: 8/26 (35.3G/131.9G) | committed: 0/32 (0.0/131.9G) | ignored: 0
chaiml-q235b-kimid-judg-34515-v1-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 18 | committing: 0 | waiting: 46
chaiml-q235b-kimid-judg-34515-v1-uploader: ---------------------------------------------------
2026-04-01T14:20:45.198065+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader:                              
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
chaiml-q235b-kimid-judg-34515-v1-uploader: ---------- 2026-04-01 14:21:30 (0:02:00) ----------
chaiml-q235b-kimid-judg-34515-v1-uploader: Files:   hashed 32/32 (131.9G/131.9G) | pre-uploaded: 26/26 (131.9G/131.9G) | committed: 0/32 (0.0/131.9G) | ignored: 0
chaiml-q235b-kimid-judg-34515-v1-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 0 | committing: 1 | waiting: 63
chaiml-q235b-kimid-judg-34515-v1-uploader: ---------------------------------------------------
2026-04-01T14:21:45.429112+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
chaiml-q235b-kimid-judg-34515-v1-uploader:                              Processed model ChaiML/q235b_kimid_judge_dpo-step428-merged in 1179.733s
chaiml-q235b-kimid-judg-34515-v1-uploader: creating bucket guanaco-vllm-models
chaiml-q235b-kimid-judg-34515-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-34515-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-q235b-kimid-judg-34515-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-q235b-kimid-judg-34515-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-q235b-kimid-judg-34515-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-34515-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-q235b-kimid-judg-34515-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-34515-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-q235b-kimid-judg-34515-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-34515-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-q235b-kimid-judg-34515-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-q235b-kimid-judg-34515-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-q235b-kimid-judg-34515-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-q235b-kimid-judg-34515-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-q235b-kimid-judg-34515-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-q235b-kimid-judg-34515-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-q235b-kimid-judg-34515-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-q235b-kimid-judg-34515-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/generation_config.json
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/config.json
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/quantization_config.json
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/tokenizer_config.json
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/chat_template.jinja
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model.safetensors.index.json
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/tokenizer.json
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00025-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00025-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00005-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00005-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00017-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00017-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00014-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00014-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00018-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00018-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00002-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00002-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00010-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00010-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00006-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00006-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00016-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00016-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00020-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00020-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00011-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00011-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00012-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00012-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00023-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00023-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00015-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00015-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00004-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00004-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00021-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00021-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00022-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00022-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00019-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00019-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00024-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00024-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00007-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00007-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00001-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00001-of-00025.safetensors
chaiml-q235b-kimid-judg-34515-v1-uploader: cp /dev/shm/model_output/model-00013-of-00025.safetensors s3://guanaco-vllm-models/chaiml-q235b-kimid-judg-34515-v1/default/model-00013-of-00025.safetensors
Job chaiml-q235b-kimid-judg-34515-v1-uploader completed after 1274.16s with status: succeeded
Stopping job with name chaiml-q235b-kimid-judg-34515-v1-uploader
Pipeline stage VLLMUploader completed in 1274.90s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.13s
run pipeline stage %s
Running pipeline stage VLLMTemplater
2026-04-01T14:22:45.542406+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
Pipeline stage VLLMTemplater completed in 4.62s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-q235b-kimid-judg-34515-v1
Waiting for inference service chaiml-q235b-kimid-judg-34515-v1 to be ready
2026-04-01T14:23:45.643690+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
2026-04-01T14:24:45.754546+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
2026-04-01T14:25:45.865956+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service chaiml-q235b-kimid-judg-34515-v1 ready after 209.2011992931366s
Pipeline stage VLLMDeployer completed in 209.85s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.5586886405944824s
Received healthy response to inference request in 1.4495093822479248s
Received healthy response to inference request in 3.547304153442383s
Received healthy response to inference request in 1.5561800003051758s
Received healthy response to inference request in 1.5102787017822266s
Received healthy response to inference request in 1.7236964702606201s
Received healthy response to inference request in 1.550095558166504s
Received healthy response to inference request in 1.529081106185913s
Received healthy response to inference request in 1.5452344417572021s
Received healthy response to inference request in 1.9866511821746826s
Received healthy response to inference request in 1.550440788269043s
Received healthy response to inference request in 1.661895513534546s
Received healthy response to inference request in 1.484555721282959s
2026-04-01T14:26:46.018856+00:00 monitor updated for chaiml-q235b-kimid-judg_34515_v1
Received healthy response to inference request in 1.5937345027923584s
Received healthy response to inference request in 1.4939160346984863s
Received healthy response to inference request in 1.7971076965332031s
Received healthy response to inference request in 1.5627987384796143s
Received healthy response to inference request in 2.486372470855713s
Received healthy response to inference request in 2.0270707607269287s
Received healthy response to inference request in 1.4461283683776855s
Received healthy response to inference request in 1.6573255062103271s
Received healthy response to inference request in 1.5527832508087158s
Received healthy response to inference request in 1.4422118663787842s
Received healthy response to inference request in 1.571840524673462s
Received healthy response to inference request in 2.085664987564087s
Received healthy response to inference request in 1.4906666278839111s
Received healthy response to inference request in 1.474541425704956s
Received healthy response to inference request in 1.710845947265625s
Received healthy response to inference request in 1.605207920074463s
Received healthy response to inference request in 1.7364840507507324s
30 requests
0 failed requests
5th percentile: 1.4476498246192933
10th percentile: 1.4720382213592529
20th percentile: 1.4932661533355713
30th percentile: 1.5403884410858155
40th percentile: 1.5518462657928467
50th percentile: 1.567319631576538
60th percentile: 1.6260549545288085
70th percentile: 1.7147011041641236
80th percentile: 1.8350163936614996
90th percentile: 2.12573573589325
95th percentile: 3.0698848962783782
99th percentile: 3.5553871393203735
mean time: 1.7796104113260904
Pipeline stage StressChecker completed in 57.43s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.57s
Shutdown handler de-registered
chaiml-q235b-kimid-judg_34515_v1 status is now deployed due to DeploymentManager action
chaiml-q235b-kimid-judg_34515_v1 status is now inactive due to auto deactivation removed underperforming models