developer_uid: chai_backend_admin
submission_id: chaiml-ssnew-v5-dpo-lr_24415_v25
model_name: chaiml-ssnew-v5-dpo-lr_24415_v25
model_group: ChaiML/ssnew-v5-dpo-lr5e
status: torndown
timestamp: 2026-02-12T23:51:51+00:00
num_battles: 10364
num_wins: 5115
celo_rating: 1305.37
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/ssnew-v5-dpo-lr5e6b01-lora
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 64
reward_model: default
display_name: chaiml-ssnew-v5-dpo-lr_24415_v25
is_internal_developer: True
language_model: ChaiML/ssnew-v5-dpo-lr5e6b01-lora
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-09
win_ratio: 0.49353531455036664
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '</s>', 'You:', '\n'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': 'You: {message}\n', 'response_template': '####\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-ssnew-v5-dpo-lr-24415-v25-uploader
Waiting for job on chaiml-ssnew-v5-dpo-lr-24415-v25-uploader to finish
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: Using quantization_mode: none
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: Downloading snapshot of ChaiML/ssnew-v5-dpo-lr5e6b01-lora...
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: 
Fetching 18 files:   0%|          | 0/18 [00:00<?, ?it/s]
Fetching 18 files:   6%|▌         | 1/18 [00:00<00:06,  2.59it/s]
Fetching 18 files:  28%|██▊       | 5/18 [00:12<00:34,  2.64s/it]
Fetching 18 files:  39%|███▉      | 7/18 [00:15<00:24,  2.20s/it]
Fetching 18 files:  44%|████▍     | 8/18 [00:15<00:17,  1.77s/it]
Fetching 18 files:  50%|█████     | 9/18 [00:15<00:12,  1.39s/it]
Fetching 18 files:  72%|███████▏  | 13/18 [00:19<00:05,  1.09s/it]
Fetching 18 files: 100%|██████████| 18/18 [00:19<00:00,  1.07s/it]
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: Downloaded in 19.350s
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: Processed model ChaiML/ssnew-v5-dpo-lr5e6b01-lora in 36.702s
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: creating bucket guanaco-vllm-models
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/README.md
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/.gitattributes
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/config.json
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/generation_config.json
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model.safetensors.index.json
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/special_tokens_map.json
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/tokenizer_config.json
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/tokenizer.json
Failed to get response for submission chaiml-csfs-v3-3-dpo-l_86358_v23: HTTPConnectionPool(host='chaiml-csfs-v3-3-dpo-l-86358-v23-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00010-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00010-of-00010.safetensors
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00001-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00001-of-00010.safetensors
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00007-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00007-of-00010.safetensors
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00002-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00002-of-00010.safetensors
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00008-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00008-of-00010.safetensors
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00003-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00003-of-00010.safetensors
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00004-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00004-of-00010.safetensors
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00006-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00006-of-00010.safetensors
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00005-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00005-of-00010.safetensors
chaiml-ssnew-v5-dpo-lr-24415-v25-uploader: cp /dev/shm/model_output/model-00009-of-00010.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-24415-v25/model-00009-of-00010.safetensors
Job chaiml-ssnew-v5-dpo-lr-24415-v25-uploader completed after 289.49s with status: succeeded
Stopping job with name chaiml-ssnew-v5-dpo-lr-24415-v25-uploader
Pipeline stage VLLMUploader completed in 290.00s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-ssnew-v5-dpo-lr-24415-v25
Waiting for inference service chaiml-ssnew-v5-dpo-lr-24415-v25 to be ready
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-ssnew-v5-dpo-lr-24415-v25 ready after 684.4201323986053s
Pipeline stage VLLMDeployer completed in 685.12s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.307666778564453s
Received healthy response to inference request in 2.6708438396453857s
Received healthy response to inference request in 2.316889762878418s
Received healthy response to inference request in 2.428199291229248s
Received healthy response to inference request in 2.4286460876464844s
Received healthy response to inference request in 2.755650520324707s
Received healthy response to inference request in 2.9661800861358643s
Received healthy response to inference request in 2.1777446269989014s
Received healthy response to inference request in 2.2538955211639404s
Received healthy response to inference request in 2.1734752655029297s
Received healthy response to inference request in 2.6344411373138428s
Received healthy response to inference request in 2.3228869438171387s
Received healthy response to inference request in 2.288571834564209s
Received healthy response to inference request in 2.474806070327759s
Received healthy response to inference request in 2.290050745010376s
Received healthy response to inference request in 2.2186052799224854s
Received healthy response to inference request in 2.480402708053589s
Received healthy response to inference request in 2.2177326679229736s
Received healthy response to inference request in 2.4252007007598877s
Received healthy response to inference request in 2.7301008701324463s
Received healthy response to inference request in 2.444021701812744s
Received healthy response to inference request in 2.3255136013031006s
Received healthy response to inference request in 2.354820728302002s
Received healthy response to inference request in 2.1663405895233154s
Received healthy response to inference request in 2.181678533554077s
Received healthy response to inference request in 2.4815120697021484s
Received healthy response to inference request in 2.338383913040161s
Received healthy response to inference request in 2.6561999320983887s
Received healthy response to inference request in 2.8514480590820312s
Received healthy response to inference request in 2.252732276916504s
30 requests
0 failed requests
5th percentile: 2.175396478176117
10th percentile: 2.1812851428985596
20th percentile: 2.2459068775177
30th percentile: 2.289607071876526
40th percentile: 2.3204880714416505
50th percentile: 2.3466023206710815
60th percentile: 2.4283780097961425
70th percentile: 2.4764850616455076
80th percentile: 2.638792896270752
90th percentile: 2.7326558351516725
95th percentile: 2.808339166641235
99th percentile: 2.9329077982902527
mean time: 2.4204880714416506
Pipeline stage StressChecker completed in 75.96s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
chaiml-ssnew-v5-dpo-lr_24415_v25 status is now deployed due to DeploymentManager action
chaiml-ssnew-v5-dpo-lr_24415_v25 status is now inactive due to auto deactivation removed underperforming models
chaiml-ssnew-v5-dpo-lr_24415_v25 status is now torndown due to DeploymentManager action