chaiml-reward-dpo-6cee-_18001

developer_uid: rirv938

submission_id: chaiml-reward-dpo-6cee-_18001_v2

model_name: chaiml-reward-dpo-6cee-_18001_v2

model_group: ChaiML/reward-dpo-6cee-c

status: inactive

timestamp: 2026-02-20T04:26:56+00:00

num_battles: 10789

num_wins: 6373

celo_rating: 1361.42

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: basic

model_repo: ChaiML/reward-dpo-6cee-chaiml-235b-sft-new-rm-_42002_v1-W4A16

model_architecture: Qwen3MoeForCausalLM

model_num_parameters: 18790207488.0

best_of: 8

max_input_tokens: 2048

max_output_tokens: 80

reward_model: default

display_name: chaiml-reward-dpo-6cee-_18001_v2

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: ChaiML/reward-dpo-6cee-chaiml-235b-sft-new-rm-_42002_v1-W4A16

model_size: 19B

ranking_group: single

us_pacific_date: 2026-02-19

win_ratio: 0.5906942256001483

generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '###', '<|im_end|>', '<|im_start|>', 'You:'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}

formatter: {'memory_template': '<|im_start|>system\nRespond as a high quality storyteller.<|im_end|>\n<|im_start|>user\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|im_end|>\n<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-reward-dpo-6cee-18001-v2-uploader
Waiting for job on chaiml-reward-dpo-6cee-18001-v2-uploader to finish
HTTP Request: %s %s "%s %d %s"
chaiml-reward-dpo-6cee-18001-v2-uploader: Using quantization_mode: w4a16
chaiml-reward-dpo-6cee-18001-v2-uploader: Repo ChaiML/reward-dpo-6cee-chaiml-235b-sft-new-rm-_42002_v1-W4A16 already ends in W4A16. Skipping...
chaiml-reward-dpo-6cee-18001-v2-uploader: Checking if ChaiML/reward-dpo-6cee-chaiml-235b-sft-new-rm-_42002_v1-W4A16 already exists in ChaiML
chaiml-reward-dpo-6cee-18001-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-reward-dpo-6cee-18001-v2-uploader: Downloading snapshot of ChaiML/reward-dpo-6cee-chaiml-235b-sft-new-rm-_42002_v1-W4A16...
chaiml-reward-dpo-6cee-18001-v2-uploader: Downloaded in 66.694s
chaiml-reward-dpo-6cee-18001-v2-uploader: Processed model ChaiML/reward-dpo-6cee-chaiml-235b-sft-new-rm-_42002_v1-W4A16 in 67.233s
chaiml-reward-dpo-6cee-18001-v2-uploader: creating bucket guanaco-vllm-models
chaiml-reward-dpo-6cee-18001-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-6cee-18001-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-reward-dpo-6cee-18001-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-reward-dpo-6cee-18001-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-reward-dpo-6cee-18001-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-6cee-18001-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-reward-dpo-6cee-18001-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-6cee-18001-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-reward-dpo-6cee-18001-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-6cee-18001-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-reward-dpo-6cee-18001-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-dpo-6cee-18001-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/tokenizer.json
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00027-of-00027.safetensors
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00024-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00018-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00022-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00025-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00023-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00014-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00009-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00010-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00004-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00017-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00008-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00006-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00003-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00007-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00013-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00005-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00019-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00021-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00012-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00016-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00026-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00002-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00011-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00001-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00020-of-00027.safetensors
chaiml-reward-dpo-6cee-18001-v2-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-6cee-18001-v2/default/model-00015-of-00027.safetensors
Job chaiml-reward-dpo-6cee-18001-v2-uploader completed after 238.84s with status: succeeded
Stopping job with name chaiml-reward-dpo-6cee-18001-v2-uploader
Pipeline stage VLLMUploader completed in 239.35s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-reward-dpo-6cee-18001-v2
Waiting for inference service chaiml-reward-dpo-6cee-18001-v2 to be ready
Failed to get response for submission chaiml-grpo-q235b-kimid_37540_v1: HTTPConnectionPool(host='chaiml-grpo-q235b-kimid-37540-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-reward-dpo-6cee-18001-v2 ready after 533.2800107002258s
Pipeline stage VLLMDeployer completed in 533.96s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.108132839202881s
Received healthy response to inference request in 2.142162322998047s
Received healthy response to inference request in 2.008883237838745s
Received healthy response to inference request in 2.1125071048736572s
Received healthy response to inference request in 1.921219825744629s
Received healthy response to inference request in 2.1461215019226074s
Received healthy response to inference request in 1.9974133968353271s
Received healthy response to inference request in 1.9729647636413574s
Received healthy response to inference request in 1.9912652969360352s
Received healthy response to inference request in 1.8883421421051025s
Received healthy response to inference request in 2.266608953475952s
Received healthy response to inference request in 1.9466521739959717s
Received healthy response to inference request in 2.067641019821167s
Received healthy response to inference request in 1.9821949005126953s
Received healthy response to inference request in 2.0610077381134033s
Received healthy response to inference request in 2.182218551635742s
Received healthy response to inference request in 1.992790699005127s
Received healthy response to inference request in 1.9852676391601562s
Received healthy response to inference request in 2.0091848373413086s
Received healthy response to inference request in 1.9203886985778809s
Received healthy response to inference request in 1.9576101303100586s
Received healthy response to inference request in 1.935335636138916s
Received healthy response to inference request in 2.158944845199585s
Received healthy response to inference request in 1.954312801361084s
Received healthy response to inference request in 2.1467580795288086s
Received healthy response to inference request in 2.2709810733795166s
Received healthy response to inference request in 1.9635274410247803s
Received healthy response to inference request in 2.057765245437622s
Received healthy response to inference request in 2.1351161003112793s
Received healthy response to inference request in 1.9880146980285645s
30 requests
0 failed requests
5th percentile: 1.9207627058029175
10th percentile: 1.9339240550994874
20th percentile: 1.9569506645202637
30th percentile: 1.979425859451294
40th percentile: 1.989965057373047
50th percentile: 2.003148317337036
60th percentile: 2.0590622425079346
70th percentile: 2.1094451189041137
80th percentile: 2.142954158782959
90th percentile: 2.1612722158432005
95th percentile: 2.2286332726478575
99th percentile: 2.269713158607483
mean time: 2.042377789815267
Pipeline stage StressChecker completed in 65.63s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
Shutdown handler de-registered
chaiml-reward-dpo-6cee-_18001_v2 status is now deployed due to DeploymentManager action
chaiml-reward-dpo-6cee-_18001_v2 status is now inactive due to auto deactivation removed underperforming models