developer_uid: Meliodia
submission_id: chaiml-ssnew-v5-dpo-lr_19068_v17
model_name: chaiml-ssnew-v5-dpo-lr5_19068_v5
model_group: ChaiML/ssnew-v5-dpo-lr5e
status: torndown
timestamp: 2026-04-03T23:42:06+00:00
num_battles: 11403
num_wins: 5703
celo_rating: 8469.92
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 16
max_input_tokens: 1750
max_output_tokens: 64
reward_model: default
display_name: chaiml-ssnew-v5-dpo-lr5_19068_v5
is_internal_developer: True
language_model: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-25
win_ratio: 0.5001315443304394
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1750, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-ssnew-v5-dpo-lr-19068-v17-uploader
Waiting for job on chaiml-ssnew-v5-dpo-lr-19068-v17-uploader to finish
chaiml-ssnew-v5-dpo-lr-19068-v16-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v16/default/model-00005-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v16-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v16/default/model-00002-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v16-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v16/default/model-00001-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v16-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v16/default/model-00004-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v16-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v16/default/model-00003-of-00006.safetensors
Job chaiml-ssnew-v5-dpo-lr-19068-v16-uploader completed after 52.59s with status: succeeded
Stopping job with name chaiml-ssnew-v5-dpo-lr-19068-v16-uploader
Pipeline stage VLLMUploader completed in 53.22s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.66s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-ssnew-v5-dpo-lr-19068-v16
Waiting for inference service chaiml-ssnew-v5-dpo-lr-19068-v16 to be ready
2026-03-25T12:27:10.022211+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v16
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: Using quantization_mode: fp8
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: Repo ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8 already ends in FP8. Skipping...
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: Checking if ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8 already exists in ChaiML
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: Downloading snapshot of ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8...
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: Downloaded in 9.052s
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: Processed model ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8 in 12.621s
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: creating bucket guanaco-vllm-models
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/generation_config.json
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/special_tokens_map.json
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/config.json
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/.gitattributes
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/tokenizer_config.json
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/model.safetensors.index.json
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/README.md
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/recipe.yaml
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/tokenizer.json
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/model-00006-of-00006.safetensors
2026-03-25T12:28:00.866659+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v17
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/model-00002-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/model-00004-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/model-00003-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v17-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v17/default/model-00001-of-00006.safetensors
Job chaiml-ssnew-v5-dpo-lr-19068-v17-uploader completed after 64.95s with status: succeeded
Stopping job with name chaiml-ssnew-v5-dpo-lr-19068-v17-uploader
Pipeline stage VLLMUploader completed in 65.62s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.42s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-ssnew-v5-dpo-lr-19068-v17
Waiting for inference service chaiml-ssnew-v5-dpo-lr-19068-v17 to be ready
2026-03-25T12:28:10.160155+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v16
2026-03-25T12:29:01.013326+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v17
2026-03-25T12:29:10.309382+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v16
Inference service chaiml-ssnew-v5-dpo-lr-19068-v16 ready after 160.41194534301758s
Pipeline stage VLLMDeployer completed in 161.12s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.9114251136779785s
Received healthy response to inference request in 5.682546377182007s
2026-03-25T12:30:01.219316+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v17
Received healthy response to inference request in 5.717736005783081s
Received healthy response to inference request in 2.754917621612549s
Received healthy response to inference request in 2.7756428718566895s
2026-03-25T12:30:10.474385+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v16
Received healthy response to inference request in 2.751253366470337s
Received healthy response to inference request in 2.7148733139038086s
Received healthy response to inference request in 2.734367847442627s
Received healthy response to inference request in 2.8363075256347656s
Received healthy response to inference request in 2.9345638751983643s
Received healthy response to inference request in 2.7194292545318604s
Received healthy response to inference request in 2.748924493789673s
Received healthy response to inference request in 2.710972309112549s
Received healthy response to inference request in 2.7340240478515625s
Received healthy response to inference request in 2.745279550552368s
Received healthy response to inference request in 2.7431089878082275s
Received healthy response to inference request in 2.734032154083252s
Received healthy response to inference request in 2.7357711791992188s
Inference service chaiml-ssnew-v5-dpo-lr-19068-v17 ready after 160.36581826210022s
Pipeline stage VLLMDeployer completed in 161.10s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7188215255737305s
Received healthy response to inference request in 5.708561658859253s
Received healthy response to inference request in 5.139904975891113s
Received healthy response to inference request in 2.7774107456207275s
Received healthy response to inference request in 2.746506452560425s
2026-03-25T12:31:01.373941+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v17
Received healthy response to inference request in 2.770519733428955s
Received healthy response to inference request in 5.921968221664429s
Received healthy response to inference request in 2.9105961322784424s
Received healthy response to inference request in 2.767886161804199s
Received healthy response to inference request in 5.737023830413818s
Received healthy response to inference request in 2.788250207901001s
2026-03-25T12:31:10.722552+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v16
Received healthy response to inference request in 2.724670648574829s
Received healthy response to inference request in 2.754671812057495s
Received healthy response to inference request in 2.7294771671295166s
Received healthy response to inference request in 3.0772571563720703s
Received healthy response to inference request in 2.8672947883605957s
Received healthy response to inference request in 6.047596216201782s
Received healthy response to inference request in 2.7915446758270264s
Received healthy response to inference request in 5.841487884521484s
Received healthy response to inference request in 2.8173489570617676s
Received healthy response to inference request in 2.8619565963745117s
30 requests
0 failed requests
5th percentile: 2.7166500091552734
10th percentile: 2.7193684816360473
20th percentile: 2.734300708770752
30th percentile: 2.744628381729126
40th percentile: 2.7503218173980715
50th percentile: 2.761401891708374
60th percentile: 2.780685806274414
70th percentile: 2.863558053970337
80th percentile: 2.963102531433106
90th percentile: 5.686065340042115
95th percentile: 5.7857995390892025
Received healthy response to inference request in 2.8328917026519775s
99th percentile: 5.891143317222595
mean time: 3.264344310760498
Pipeline stage StressChecker completed in 103.68s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.03s
Shutdown handler de-registered
chaiml-ssnew-v5-dpo-lr_19068_v16 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 2.7307448387145996s
Received healthy response to inference request in 2.9102985858917236s
Received healthy response to inference request in 5.911587715148926s
Received healthy response to inference request in 2.7452054023742676s
Received healthy response to inference request in 2.7916293144226074s
Received healthy response to inference request in 2.789806365966797s
Received healthy response to inference request in 2.8797810077667236s
Received healthy response to inference request in 2.9001097679138184s
Received healthy response to inference request in 2.7438297271728516s
2026-03-25T12:32:01.836765+00:00 monitor updated for chaiml-ssnew-v5-dpo-lr_19068_v17
Received healthy response to inference request in 2.765079975128174s
Received healthy response to inference request in 2.744802713394165s
Received healthy response to inference request in 2.8411333560943604s
Received healthy response to inference request in 2.7595174312591553s
Received healthy response to inference request in 2.790621519088745s
Received healthy response to inference request in 2.780644655227661s
Received healthy response to inference request in 2.860997200012207s
Received healthy response to inference request in 2.779902696609497s
Received healthy response to inference request in 2.8483455181121826s
Received healthy response to inference request in 2.7785871028900146s
Received healthy response to inference request in 2.808483839035034s
30 requests
0 failed requests
5th percentile: 2.730047619342804
10th percentile: 2.7425212383270265
20th percentile: 2.7566550254821776
30th percentile: 2.7782341957092287
40th percentile: 2.7861416816711424
50th percentile: 2.791586995124817
60th percentile: 2.8235660552978517
70th percentile: 2.85214102268219
80th percentile: 2.9021475315093994
90th percentile: 5.75448021888733
95th percentile: 5.917296993732452
99th percentile: 6.01116409778595
mean time: 3.308320085207621
Pipeline stage StressChecker completed in 102.96s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.73s
Shutdown handler de-registered
chaiml-ssnew-v5-dpo-lr_19068_v17 status is now deployed due to DeploymentManager action
chaiml-ssnew-v5-dpo-lr_19068_v17 status is now inactive due to auto deactivation removed underperforming models
chaiml-ssnew-v5-dpo-lr_19068_v17 status is now torndown due to DeploymentManager action