chaiml-qwen3-bobo-step2_86905

developer_uid: rirv938

submission_id: chaiml-qwen3-bobo-step2_86905_v1

model_name: chaiml-qwen3-bobo-step2_86905_v1

model_group: ChaiML/qwen3_bobo-step29

status: torndown

timestamp: 2026-03-30T01:31:46+00:00

num_battles: 10558

num_wins: 5494

celo_rating: 1307.44

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: basic

model_repo: ChaiML/qwen3_bobo-step2970-merged

model_architecture: Qwen3ForCausalLM

model_num_parameters: 30497182720.0

best_of: 8

max_input_tokens: 2048

max_output_tokens: 80

reward_model: default

display_name: chaiml-qwen3-bobo-step2_86905_v1

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: ChaiML/qwen3_bobo-step2970-merged

model_size: 30B

ranking_group: single

us_pacific_date: 2026-03-26

win_ratio: 0.5203637052472059

generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '###', '<|im_end|>', '<|im_start|>', 'You:'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}

formatter: {'memory_template': '<|im_start|>system\nRespond as a high quality storyteller.<|im_end|>\n<|im_start|>user\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|im_end|>\n<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-qwen3-bobo-step2-86905-v1-uploader
Waiting for job on chaiml-qwen3-bobo-step2-86905-v1-uploader to finish
chaiml-qwen3-bobo-step2-86905-v1-uploader: Using quantization_mode: none
chaiml-qwen3-bobo-step2-86905-v1-uploader: Downloading snapshot of ChaiML/qwen3_bobo-step2970-merged...
chaiml-qwen3-bobo-step2-86905-v1-uploader: Downloaded in 24.975s
2026-03-26T19:54:05.649882+00:00 monitor updated for chaiml-qwen3-bobo-step2_86905_v1
chaiml-qwen3-bobo-step2-86905-v1-uploader: Processed model ChaiML/qwen3_bobo-step2970-merged in 49.495s
chaiml-qwen3-bobo-step2-86905-v1-uploader: creating bucket guanaco-vllm-models
chaiml-qwen3-bobo-step2-86905-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen3-bobo-step2-86905-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-qwen3-bobo-step2-86905-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-qwen3-bobo-step2-86905-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-qwen3-bobo-step2-86905-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen3-bobo-step2-86905-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-qwen3-bobo-step2-86905-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen3-bobo-step2-86905-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-qwen3-bobo-step2-86905-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen3-bobo-step2-86905-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-qwen3-bobo-step2-86905-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-qwen3-bobo-step2-86905-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-qwen3-bobo-step2-86905-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-qwen3-bobo-step2-86905-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-qwen3-bobo-step2-86905-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-qwen3-bobo-step2-86905-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-qwen3-bobo-step2-86905-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-qwen3-bobo-step2-86905-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/.gitattributes
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/README.md
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/config.json
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/chat_template.jinja
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/args.json
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/generation_config.json
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/special_tokens_map.json
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/added_tokens.json
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/tokenizer_config.json
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model.safetensors.index.json
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/merges.txt
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/vocab.json
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/tokenizer.json
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00014-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00014-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00007-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00007-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00013-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00013-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00003-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00003-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00006-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00006-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00011-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00011-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00010-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00010-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00012-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00012-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00002-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00002-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00008-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00008-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00009-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00009-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00005-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00005-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00001-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00001-of-00014.safetensors
chaiml-qwen3-bobo-step2-86905-v1-uploader: cp /dev/shm/model_output/model-00004-of-00014.safetensors s3://guanaco-vllm-models/chaiml-qwen3-bobo-step2-86905-v1/default/model-00004-of-00014.safetensors
Job chaiml-qwen3-bobo-step2-86905-v1-uploader completed after 83.6s with status: succeeded
Stopping job with name chaiml-qwen3-bobo-step2-86905-v1-uploader
Pipeline stage VLLMUploader completed in 84.16s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.97s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-qwen3-bobo-step2-86905-v1
Waiting for inference service chaiml-qwen3-bobo-step2-86905-v1 to be ready
2026-03-26T19:55:05.739432+00:00 monitor updated for chaiml-qwen3-bobo-step2_86905_v1
2026-03-26T19:56:05.846426+00:00 monitor updated for chaiml-qwen3-bobo-step2_86905_v1
2026-03-26T19:57:05.958679+00:00 monitor updated for chaiml-qwen3-bobo-step2_86905_v1
Inference service chaiml-qwen3-bobo-step2-86905-v1 ready after 160.6136598587036s
Pipeline stage VLLMDeployer completed in 164.73s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.404425144195557s
Received healthy response to inference request in 9.01597809791565s
Received healthy response to inference request in 9.378403186798096s
Received healthy response to inference request in 8.960120677947998s
Received healthy response to inference request in 2.5013349056243896s
Received healthy response to inference request in 2.4354703426361084s
Received healthy response to inference request in 2.325058698654175s
2026-03-26T19:58:06.062010+00:00 monitor updated for chaiml-qwen3-bobo-step2_86905_v1
Received healthy response to inference request in 8.925965785980225s
Received healthy response to inference request in 2.4034523963928223s
Received healthy response to inference request in 2.5517566204071045s
Received healthy response to inference request in 2.4865851402282715s
Received healthy response to inference request in 2.3882555961608887s
Received healthy response to inference request in 2.534229278564453s
Received healthy response to inference request in 2.516280174255371s
Received healthy response to inference request in 2.4013898372650146s
Received healthy response to inference request in 2.5582282543182373s
Received healthy response to inference request in 2.4841508865356445s
Received healthy response to inference request in 2.4039018154144287s
Received healthy response to inference request in 2.3927431106567383s
Received healthy response to inference request in 2.3576200008392334s
Received healthy response to inference request in 2.362424373626709s
Received healthy response to inference request in 2.347813367843628s
Received healthy response to inference request in 2.336541175842285s
Received healthy response to inference request in 2.3407716751098633s
Received healthy response to inference request in 2.488191604614258s
Received healthy response to inference request in 2.3678972721099854s
Received healthy response to inference request in 2.5866167545318604s
Received healthy response to inference request in 2.492579460144043s
Received healthy response to inference request in 2.3623459339141846s
Received healthy response to inference request in 2.467438220977783s
30 requests
0 failed requests
5th percentile: 2.3384449005126955
10th percentile: 2.3471091985702515
20th percentile: 2.362408685684204
30th percentile: 2.3913968563079835
40th percentile: 2.403722047805786
50th percentile: 2.475794553756714
60th percentile: 2.489946746826172
70th percentile: 2.5216649055480955
80th percentile: 2.563905954360962
90th percentile: 8.965706419944762
95th percentile: 9.215311896800994
99th percentile: 9.396878776550293
mean time: 3.5525989929835
Pipeline stage StressChecker completed in 109.49s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
2026-03-26T19:59:06.223436+00:00 monitor updated for chaiml-qwen3-bobo-step2_86905_v1
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.85s
Shutdown handler de-registered
chaiml-qwen3-bobo-step2_86905_v1 status is now deployed due to DeploymentManager action
chaiml-qwen3-bobo-step2_86905_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-qwen3-bobo-step2_86905_v1 status is now torndown due to DeploymentManager action