developer_uid: rirv938
submission_id: chaiml-qwen-bobo-dpo-ju_56781_v7
model_name: chaiml-qwen-bobo-dpo-ju_56781_v7
model_group: ChaiML/qwen_bobo_dpo_jud
status: inactive
timestamp: 2026-04-06T20:57:12+00:00
num_battles: 3558454
num_wins: 1942234
celo_rating: 1335.04
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/qwen_bobo_dpo_judge_plus_reward_700_merged
model_architecture: Qwen3_5ForConditionalGeneration
model_num_parameters: 23564784640.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-qwen-bobo-dpo-ju_56781_v7
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/qwen_bobo_dpo_judge_plus_reward_700_merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-04-06
win_ratio: 0.5458083763342171
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', 'You:', '###', '</s>', '<|im_start|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '<|im_start|>system\nRespond as a high quality storyteller.<|im_end|>\n<|im_start|>user\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|im_end|>\n<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-qwen-bobo-dpo-ju-56781-v7-uploader
Waiting for job on chaiml-qwen-bobo-dpo-ju-56781-v7-uploader to finish
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: Using quantization_mode: none
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: Downloading snapshot of ChaiML/qwen_bobo_dpo_judge_plus_reward_700_merged...
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: Downloaded in 30.290s
2026-03-28T23:57:49.942955+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: Processed model ChaiML/qwen_bobo_dpo_judge_plus_reward_700_merged in 50.221s
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: creating bucket guanaco-vllm-models
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/.gitattributes
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/config.json
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/model.safetensors.index.json
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/README.md
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/chat_template.jinja
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/tokenizer_config.json
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/generation_config.json
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/tokenizer.json
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/model-00002-of-00002.safetensors s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/model-00002-of-00002.safetensors
2026-03-28T23:58:50.030161+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
chaiml-qwen-bobo-dpo-ju-56781-v7-uploader: cp /dev/shm/model_output/model-00001-of-00002.safetensors s3://guanaco-vllm-models/chaiml-qwen-bobo-dpo-ju-56781-v7/default/model-00001-of-00002.safetensors
Job chaiml-qwen-bobo-dpo-ju-56781-v7-uploader completed after 143.18s with status: succeeded
Stopping job with name chaiml-qwen-bobo-dpo-ju-56781-v7-uploader
Pipeline stage VLLMUploader completed in 143.65s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.66s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-qwen-bobo-dpo-ju-56781-v7
Waiting for inference service chaiml-qwen-bobo-dpo-ju-56781-v7 to be ready
2026-03-28T23:59:50.121648+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
2026-03-29T00:00:50.219791+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
2026-03-29T00:01:50.316526+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
Inference service chaiml-qwen-bobo-dpo-ju-56781-v7 ready after 170.23817205429077s
Pipeline stage VLLMDeployer completed in 170.67s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-29T00:02:50.413971+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 16.739395141601562s
2026-03-29T00:03:50.513111+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.562861442565918s
Received healthy response to inference request in 9.271799564361572s
Received healthy response to inference request in 9.150383949279785s
Received healthy response to inference request in 2.428354024887085s
Received healthy response to inference request in 2.4417645931243896s
Received healthy response to inference request in 9.493242740631104s
2026-03-29T00:04:50.614325+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.7559008598327637s
Received healthy response to inference request in 2.614069700241089s
Received healthy response to inference request in 2.8123888969421387s
Received healthy response to inference request in 2.4601848125457764s
Received healthy response to inference request in 2.4685590267181396s
Received healthy response to inference request in 2.447877883911133s
Received healthy response to inference request in 2.5493733882904053s
Received healthy response to inference request in 2.43765926361084s
Received healthy response to inference request in 2.47548770904541s
Received healthy response to inference request in 2.457174062728882s
Received healthy response to inference request in 2.5822818279266357s
Received healthy response to inference request in 2.4631168842315674s
Received healthy response to inference request in 2.5261168479919434s
Received healthy response to inference request in 2.5468478202819824s
Received healthy response to inference request in 2.4549171924591064s
Received healthy response to inference request in 2.637237548828125s
Received healthy response to inference request in 2.4572458267211914s
30 requests
6 failed requests
5th percentile: 2.4395066618919374
10th percentile: 2.4472665548324586
20th percentile: 2.4572314739227297
30th percentile: 2.466926383972168
40th percentile: 2.5385554313659666
50th percentile: 2.572571635246277
60th percentile: 2.6847028732299805
70th percentile: 9.18680863380432
80th percentile: 17.41216039657594
90th percentile: 20.13468909263611
95th percentile: 20.16400475502014
99th percentile: 20.3072172164917
mean time: 7.2090145190556845
%s, retrying in %s seconds...
Received healthy response to inference request in 2.447392702102661s
2026-03-29T00:05:50.714352+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
Received healthy response to inference request in 2.3798069953918457s
Received healthy response to inference request in 2.5183613300323486s
Received healthy response to inference request in 2.403365135192871s
Received healthy response to inference request in 2.3758981227874756s
Received healthy response to inference request in 2.4954261779785156s
Received healthy response to inference request in 2.3558645248413086s
Received healthy response to inference request in 2.410249948501587s
Received healthy response to inference request in 2.4266884326934814s
Received healthy response to inference request in 2.5324764251708984s
Received healthy response to inference request in 2.619351863861084s
Received healthy response to inference request in 2.5209383964538574s
Received healthy response to inference request in 2.36506724357605s
Received healthy response to inference request in 2.6417040824890137s
Received healthy response to inference request in 2.4660515785217285s
Received healthy response to inference request in 3.026236057281494s
Received healthy response to inference request in 2.5144331455230713s
Received healthy response to inference request in 2.4709088802337646s
Received healthy response to inference request in 2.697254180908203s
Received healthy response to inference request in 2.511235237121582s
Received healthy response to inference request in 2.5356338024139404s
Received healthy response to inference request in 2.495622158050537s
Received healthy response to inference request in 2.447122573852539s
Received healthy response to inference request in 2.5588953495025635s
Received healthy response to inference request in 2.538602828979492s
2026-03-29T00:06:50.817050+00:00 monitor updated for chaiml-qwen-bobo-dpo-ju_56781_v7
Received healthy response to inference request in 2.4116666316986084s
Received healthy response to inference request in 2.449063301086426s
Received healthy response to inference request in 2.440854549407959s
Received healthy response to inference request in 2.3163986206054688s
Received healthy response to inference request in 2.4452569484710693s
30 requests
0 failed requests
5th percentile: 2.3600057482719423
10th percentile: 2.374815034866333
20th percentile: 2.4088729858398437
30th percentile: 2.436604714393616
40th percentile: 2.4472846508026125
50th percentile: 2.4684802293777466
60th percentile: 2.501867389678955
70th percentile: 2.519134449958801
80th percentile: 2.5362276077270507
90th percentile: 2.6215870857238768
95th percentile: 2.6722566366195677
99th percentile: 2.93083131313324
mean time: 2.493927574157715
Pipeline stage StressChecker completed in 296.21s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
Shutdown handler de-registered
chaiml-qwen-bobo-dpo-ju_56781_v7 status is now deployed due to DeploymentManager action
chaiml-qwen-bobo-dpo-ju_56781_v7 status is now inactive due to auto deactivation removed underperforming models