chaiml-merged-qwen-35-d_39140

developer_uid: rirv938

submission_id: chaiml-merged-qwen-35-d_39140_v1

model_name: chaiml-merged-qwen-35-d_39140_v1

model_group: ChaiML/merged_qwen_35_dp

status: torndown

timestamp: 2026-03-28T00:21:58+00:00

num_battles: 10474

num_wins: 5932

celo_rating: 1334.06

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: basic

model_repo: ChaiML/merged_qwen_35_dpo_lower_lr_v

model_architecture: Qwen3_5ForConditionalGeneration

model_num_parameters: 23564784640.0

best_of: 8

max_input_tokens: 2048

max_output_tokens: 80

reward_model: default

display_name: chaiml-merged-qwen-35-d_39140_v1

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: ChaiML/merged_qwen_35_dpo_lower_lr_v

model_size: 24B

ranking_group: single

us_pacific_date: 2026-03-24

win_ratio: 0.5663547832728661

generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', '###', 'You:', '<|im_start|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}

formatter: {'memory_template': '<|im_start|>system\nRespond as a high quality storyteller.<|im_end|>\n<|im_start|>user\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|im_end|>\n<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-merged-qwen-35-d-39140-v1-uploader
Waiting for job on chaiml-merged-qwen-35-d-39140-v1-uploader to finish
chaiml-merged-qwen-35-d-39140-v1-uploader: Using quantization_mode: none
chaiml-merged-qwen-35-d-39140-v1-uploader: Downloading snapshot of ChaiML/merged_qwen_35_dpo_lower_lr_v...
chaiml-merged-qwen-35-d-39140-v1-uploader: Downloaded in 41.583s
2026-03-24T18:53:14.554751+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
chaiml-merged-qwen-35-d-39140-v1-uploader: Processed model ChaiML/merged_qwen_35_dpo_lower_lr_v in 61.459s
chaiml-merged-qwen-35-d-39140-v1-uploader: creating bucket guanaco-vllm-models
chaiml-merged-qwen-35-d-39140-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-merged-qwen-35-d-39140-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-merged-qwen-35-d-39140-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-merged-qwen-35-d-39140-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-merged-qwen-35-d-39140-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-merged-qwen-35-d-39140-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-merged-qwen-35-d-39140-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-merged-qwen-35-d-39140-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-merged-qwen-35-d-39140-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-merged-qwen-35-d-39140-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-merged-qwen-35-d-39140-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-merged-qwen-35-d-39140-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-merged-qwen-35-d-39140-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-merged-qwen-35-d-39140-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-merged-qwen-35-d-39140-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-merged-qwen-35-d-39140-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-merged-qwen-35-d-39140-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-merged-qwen-35-d-39140-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default
chaiml-merged-qwen-35-d-39140-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default/README.md
chaiml-merged-qwen-35-d-39140-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default/generation_config.json
chaiml-merged-qwen-35-d-39140-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default/.gitattributes
chaiml-merged-qwen-35-d-39140-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default/tokenizer_config.json
chaiml-merged-qwen-35-d-39140-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default/config.json
chaiml-merged-qwen-35-d-39140-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default/model.safetensors.index.json
chaiml-merged-qwen-35-d-39140-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default/tokenizer.json
chaiml-merged-qwen-35-d-39140-v1-uploader: cp /dev/shm/model_output/model-00002-of-00002.safetensors s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default/model-00002-of-00002.safetensors
2026-03-24T18:54:14.650055+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
chaiml-merged-qwen-35-d-39140-v1-uploader: cp /dev/shm/model_output/model-00001-of-00002.safetensors s3://guanaco-vllm-models/chaiml-merged-qwen-35-d-39140-v1/default/model-00001-of-00002.safetensors
Job chaiml-merged-qwen-35-d-39140-v1-uploader completed after 163.3s with status: succeeded
Stopping job with name chaiml-merged-qwen-35-d-39140-v1-uploader
Pipeline stage VLLMUploader completed in 163.88s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.04s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-merged-qwen-35-d-39140-v1
Waiting for inference service chaiml-merged-qwen-35-d-39140-v1 to be ready
2026-03-24T18:55:14.735891+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
2026-03-24T18:56:14.864738+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
2026-03-24T18:57:14.991638+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
Inference service chaiml-merged-qwen-35-d-39140-v1 ready after 160.53624606132507s
Pipeline stage VLLMDeployer completed in 161.65s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
function_fopal_2026-03-24 status is now inactive due to admin request
2026-03-24T18:58:15.085530+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-24T18:59:15.187318+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 9.710946559906006s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 9.817630290985107s
Received healthy response to inference request in 2.7728474140167236s
2026-03-24T19:00:15.274663+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 9.463015794754028s
Received healthy response to inference request in 2.5876882076263428s
Received healthy response to inference request in 9.560237407684326s
Received healthy response to inference request in 2.6382699012756348s
Received healthy response to inference request in 2.754472255706787s
Received healthy response to inference request in 9.585692882537842s
Received healthy response to inference request in 2.815737009048462s
Received healthy response to inference request in 2.6615681648254395s
Received healthy response to inference request in 2.640856981277466s
Received healthy response to inference request in 2.6782774925231934s
2026-03-24T19:01:15.369470+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
Received healthy response to inference request in 2.5161292552948s
Received healthy response to inference request in 2.7030417919158936s
Received healthy response to inference request in 2.733020067214966s
Received healthy response to inference request in 2.914559841156006s
Received healthy response to inference request in 2.7693984508514404s
Received healthy response to inference request in 2.649402141571045s
Received healthy response to inference request in 2.660496711730957s
Received healthy response to inference request in 2.856689929962158s
Received healthy response to inference request in 2.852992296218872s
Received healthy response to inference request in 2.6400680541992188s
30 requests
7 failed requests
5th percentile: 2.610449969768524
10th percentile: 2.6398882389068605
20th percentile: 2.6582777976989744
30th percentile: 2.6956125020980837
40th percentile: 2.763427972793579
50th percentile: 2.834364652633667
60th percentile: 5.533942222595206
70th percentile: 9.623268985748291
80th percentile: 20.11873197555542
90th percentile: 20.125581121444704
95th percentile: 20.132684898376464
99th percentile: 20.13805875301361
mean time: 7.9291599750518795
%s, retrying in %s seconds...
Received healthy response to inference request in 2.5484976768493652s
Received healthy response to inference request in 2.4363763332366943s
Received healthy response to inference request in 2.47867488861084s
Received healthy response to inference request in 2.4917736053466797s
Received healthy response to inference request in 2.505061626434326s
Received healthy response to inference request in 2.6658730506896973s
Received healthy response to inference request in 2.547886848449707s
Received healthy response to inference request in 2.596079111099243s
Received healthy response to inference request in 2.7000436782836914s
Received healthy response to inference request in 2.5286333560943604s
Received healthy response to inference request in 2.444284677505493s
Received healthy response to inference request in 2.643566370010376s
Received healthy response to inference request in 2.56661057472229s
2026-03-24T19:02:15.461192+00:00 monitor updated for chaiml-merged-qwen-35-d_39140_v1
Received healthy response to inference request in 2.4713149070739746s
Received healthy response to inference request in 3.1376395225524902s
Received healthy response to inference request in 2.566934108734131s
Received healthy response to inference request in 2.6532678604125977s
Received healthy response to inference request in 2.5517632961273193s
Received healthy response to inference request in 2.58636474609375s
Received healthy response to inference request in 2.692225933074951s
Received healthy response to inference request in 2.6504409313201904s
Received healthy response to inference request in 2.668785333633423s
Received healthy response to inference request in 2.6333436965942383s
Received healthy response to inference request in 2.900761842727661s
Received healthy response to inference request in 2.7649881839752197s
Received healthy response to inference request in 2.6155765056610107s
Received healthy response to inference request in 2.7464816570281982s
Received healthy response to inference request in 2.79337739944458s
Received healthy response to inference request in 2.62913179397583s
Received healthy response to inference request in 2.6380021572113037s
30 requests
0 failed requests
5th percentile: 2.4564482808113097
10th percentile: 2.4779388904571533
20th percentile: 2.5239190101623534
30th percentile: 2.550783610343933
40th percentile: 2.5785924911499025
50th percentile: 2.6223541498184204
60th percentile: 2.6402278423309324
70th percentile: 2.6570494174957275
80th percentile: 2.693789482116699
90th percentile: 2.767827105522156
95th percentile: 2.8524388432502743
99th percentile: 3.06894499540329
mean time: 2.6284587224324545
Pipeline stage StressChecker completed in 321.47s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.72s
Shutdown handler de-registered
chaiml-merged-qwen-35-d_39140_v1 status is now deployed due to DeploymentManager action
chaiml-merged-qwen-35-d_39140_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-merged-qwen-35-d_39140_v1 status is now torndown due to DeploymentManager action