developer_uid: rirv938
submission_id: chaiml-qwen-bobo-dpo-ju_56781_v6
model_name: chaiml-qwen-bobo-dpo-ju_56781_v6
model_group: ChaiML/qwen_bobo_dpo_jud
status: deployed
timestamp: 2026-03-28T17:54:15+00:00
num_battles: 2225
num_wins: 1281
celo_rating: 1343.7
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/qwen_bobo_dpo_judge_plus_reward_700_merged
model_architecture: Qwen3_5ForConditionalGeneration
model_num_parameters: 23564784640.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-qwen-bobo-dpo-ju_56781_v6
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/qwen_bobo_dpo_judge_plus_reward_700_merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-28
win_ratio: 0.5757303370786517
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['###', 'You:', '<|im_start|>', '</s>', '<|im_end|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '<|im_start|>system\nRespond as a high quality storyteller.<|im_end|>\n<|im_start|>user\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|im_end|>\n<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-qwen-bobo-dpo-ju-56781-v6-uploader
Waiting for job on chaiml-qwen-bobo-dpo-ju-56781-v6-uploader to finish
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: Using quantization_mode: none
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: Downloading snapshot of ChaiML/qwen_bobo_dpo_judge_plus_reward_700_merged...
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: Downloaded in 32.301s
2026-03-28T17:41:30.130086+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: Processed model ChaiML/qwen_bobo_dpo_judge_plus_reward_700_merged in 52.658s
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: creating bucket guanaco-vllm-models
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: cp /dev/shm/model_output/model-00002-of-00002.safetensors s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v6/default/model-00002-of-00002.safetensors
2026-03-28T17:42:30.222016+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
2026-03-28T17:43:30.315405+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
2026-03-28T17:44:30.445673+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
chaiml-qwen-bobo-dpo-ju-56781-v6-uploader: cp /dev/shm/model_output/model-00001-of-00002.safetensors s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v6/default/model-00001-of-00002.safetensors
Job chaiml-qwen-bobo-dpo-ju-56781-v6-uploader completed after 283.58s with status: succeeded
Stopping job with name chaiml-qwen-bobo-dpo-ju-56781-v6-uploader
Pipeline stage VLLMUploader completed in 284.03s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.97s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-qwen-bobo-dpo-ju-56781-v6
Waiting for inference service chaiml-qwen-bobo-dpo-ju-56781-v6 to be ready
2026-03-28T17:45:30.535280+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
2026-03-28T17:46:30.627775+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
2026-03-28T17:47:30.724446+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
Inference service chaiml-qwen-bobo-dpo-ju-56781-v6 ready after 170.58988523483276s
Pipeline stage VLLMDeployer completed in 171.11s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-28T17:48:30.826401+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-28T17:49:30.917882+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 16.550612926483154s
2026-03-28T17:50:31.009791+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 9.697603702545166s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.813002109527588s
Received healthy response to inference request in 2.652815341949463s
2026-03-28T17:51:31.100814+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.6137824058532715s
Received healthy response to inference request in 2.6184494495391846s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.6494033336639404s
Received healthy response to inference request in 2.5744636058807373s
Received healthy response to inference request in 9.647489309310913s
Received healthy response to inference request in 2.5605077743530273s
Received healthy response to inference request in 2.562532901763916s
Received healthy response to inference request in 2.8195953369140625s
2026-03-28T17:52:31.199822+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
Received healthy response to inference request in 2.6521003246307373s
Received healthy response to inference request in 2.838575839996338s
Received healthy response to inference request in 2.585702657699585s
Received healthy response to inference request in 2.760833263397217s
Received healthy response to inference request in 2.684532403945923s
Received healthy response to inference request in 2.5181472301483154s
Received healthy response to inference request in 2.6868834495544434s
Received healthy response to inference request in 2.84647536277771s
30 requests
10 failed requests
5th percentile: 2.5614190816879274
10th percentile: 2.5732705354690553
20th percentile: 2.617516040802002
30th percentile: 2.6526008367538454
40th percentile: 2.7312533378601076
50th percentile: 2.8290855884552
60th percentile: 9.667535066604614
70th percentile: 20.11496889591217
80th percentile: 20.120741033554076
90th percentile: 20.12603852748871
95th percentile: 20.131085014343263
99th percentile: 20.140192325115205
mean time: 9.419267797470093
%s, retrying in %s seconds...
Received healthy response to inference request in 2.861255168914795s
Received healthy response to inference request in 2.502129077911377s
Received healthy response to inference request in 2.456878900527954s
Received healthy response to inference request in 2.716714382171631s
Received healthy response to inference request in 2.4938855171203613s
Received healthy response to inference request in 2.5767972469329834s
Received healthy response to inference request in 2.5074310302734375s
Received healthy response to inference request in 2.6181063652038574s
Received healthy response to inference request in 2.5121309757232666s
Received healthy response to inference request in 2.5024235248565674s
Received healthy response to inference request in 2.504535436630249s
Received healthy response to inference request in 2.5711464881896973s
Received healthy response to inference request in 2.5574965476989746s
Received healthy response to inference request in 2.7299654483795166s
2026-03-28T17:53:31.298542+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v6
Received healthy response to inference request in 2.530388593673706s
Received healthy response to inference request in 2.587022304534912s
Received healthy response to inference request in 2.7296013832092285s
Received healthy response to inference request in 2.8535842895507812s
Received healthy response to inference request in 2.5348129272460938s
Received healthy response to inference request in 2.5532991886138916s
Received healthy response to inference request in 2.6746184825897217s
Received healthy response to inference request in 2.565066337585449s
Received healthy response to inference request in 2.558957815170288s
Received healthy response to inference request in 2.6071581840515137s
Received healthy response to inference request in 2.560192823410034s
Received healthy response to inference request in 2.822087049484253s
Received healthy response to inference request in 2.7746620178222656s
Received healthy response to inference request in 2.7995221614837646s
Received healthy response to inference request in 2.6528830528259277s
Received healthy response to inference request in 2.9840261936187744s
30 requests
0 failed requests
5th percentile: 2.497595119476318
10th percentile: 2.5023940801620483
20th percentile: 2.511190986633301
30th percentile: 2.5477533102035523
40th percentile: 2.5596988201141357
50th percentile: 2.5739718675613403
60th percentile: 2.611537456512451
70th percentile: 2.6872472524642945
80th percentile: 2.7389047622680667
90th percentile: 2.825236773490906
95th percentile: 2.8578032732009886
99th percentile: 2.9484225964546207
mean time: 2.629959297180176
Pipeline stage StressChecker completed in 366.40s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.68s
Shutdown handler de-registered
chaiml-qwen-bobo-dpo-ju_56781_v6 status is now deployed due to DeploymentManager action