developer_uid: Meliodia
submission_id: chaiml-csfs-v3-3-dpo-lr5_937_v11
model_name: chaiml-csfs-v3-3-dpo-lr5e_937_v5
model_group: ChaiML/csfs-v3-3-dpo-lr5
status: torndown
timestamp: 2026-03-28T14:18:50+00:00
num_battles: 11161
num_wins: 5522
celo_rating: 8469.92
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 16
max_input_tokens: 2048
max_output_tokens: 64
reward_model: default
display_name: chaiml-csfs-v3-3-dpo-lr5e_937_v5
is_internal_developer: True
language_model: ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-25
win_ratio: 0.49475853418152493
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': 'You: {message}\n', 'response_template': '####\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader
Waiting for job on chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader to finish
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: Using quantization_mode: fp8
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: Repo ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8 already ends in FP8. Skipping...
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: Checking if ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8 already exists in ChaiML
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: Downloading snapshot of ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8...
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: Downloaded in 9.715s
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: Processed model ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8 in 13.211s
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: creating bucket guanaco-vllm-models
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: if re.search("-\.", bucket, re.UNICODE):
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: if re.search("\.\.", bucket, re.UNICODE):
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/config.json
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/tokenizer_config.json
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/recipe.yaml
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/generation_config.json
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/model.safetensors.index.json
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/special_tokens_map.json
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/README.md
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/.gitattributes
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/tokenizer.json
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/model-00006-of-00006.safetensors
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/model-00002-of-00006.safetensors
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/model-00004-of-00006.safetensors
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/model-00003-of-00006.safetensors
chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5-937-v11/default/model-00001-of-00006.safetensors
Job chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader completed after 42.5s with status: succeeded
Stopping job with name chaiml-csfs-v3-3-dpo-lr5-937-v11-uploader
Pipeline stage VLLMUploader completed in 42.98s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.42s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-csfs-v3-3-dpo-lr5-937-v11
Waiting for inference service chaiml-csfs-v3-3-dpo-lr5-937-v11 to be ready
2026-03-25T12:29:55.874763+00:00 monitor updated for chaiml-csfs-v3-3-dpo-lr5_937_v11
2026-03-25T12:30:56.005409+00:00 monitor updated for chaiml-csfs-v3-3-dpo-lr5_937_v11
2026-03-25T12:31:56.120088+00:00 monitor updated for chaiml-csfs-v3-3-dpo-lr5_937_v11
Inference service chaiml-csfs-v3-3-dpo-lr5-937-v11 ready after 160.43260765075684s
Pipeline stage VLLMDeployer completed in 160.90s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.719215393066406s
Received healthy response to inference request in 2.748957633972168s
Received healthy response to inference request in 5.6972975730896s
Received healthy response to inference request in 2.6900179386138916s
Received healthy response to inference request in 2.7064664363861084s
Received healthy response to inference request in 5.6896350383758545s
Received healthy response to inference request in 5.693133115768433s
2026-03-25T12:32:56.219109+00:00 monitor updated for chaiml-csfs-v3-3-dpo-lr5_937_v11
Received healthy response to inference request in 2.729273796081543s
Received healthy response to inference request in 2.7983107566833496s
Received healthy response to inference request in 5.8356523513793945s
Received healthy response to inference request in 2.724184036254883s
Received healthy response to inference request in 2.7176079750061035s
Received healthy response to inference request in 2.715233087539673s
Received healthy response to inference request in 2.7213828563690186s
Received healthy response to inference request in 2.725385904312134s
Received healthy response to inference request in 2.7342324256896973s
Received healthy response to inference request in 2.807558536529541s
Received healthy response to inference request in 2.838352680206299s
Received healthy response to inference request in 2.801823854446411s
Received healthy response to inference request in 2.8080010414123535s
Received healthy response to inference request in 2.7372183799743652s
Received healthy response to inference request in 2.8328909873962402s
Received healthy response to inference request in 2.7188925743103027s
Received healthy response to inference request in 2.7335164546966553s
Received healthy response to inference request in 2.7232861518859863s
Received healthy response to inference request in 2.720360279083252s
Received healthy response to inference request in 2.769787073135376s
Received healthy response to inference request in 2.8211374282836914s
2026-03-25T12:33:56.315287+00:00 monitor updated for chaiml-csfs-v3-3-dpo-lr5_937_v11
Received healthy response to inference request in 2.766646385192871s
Received healthy response to inference request in 2.7258310317993164s
30 requests
0 failed requests
5th percentile: 2.7104114294052124
10th percentile: 2.7173704862594605
20th percentile: 2.721178340911865
30th percentile: 2.7250253438949583
40th percentile: 2.7318193912506104
50th percentile: 2.7430880069732666
60th percentile: 2.7811965465545656
70th percentile: 2.807691287994385
80th percentile: 2.833983325958252
90th percentile: 5.693549561500549
95th percentile: 5.709352374076843
99th percentile: 5.801885633468628
mean time: 3.2483763058980304
Pipeline stage StressChecker completed in 99.99s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
chaiml-csfs-v3-3-dpo-lr5_937_v11 status is now deployed due to DeploymentManager action
chaiml-csfs-v3-3-dpo-lr5_937_v11 status is now inactive due to auto deactivation removed underperforming models
chaiml-csfs-v3-3-dpo-lr5_937_v11 status is now torndown due to DeploymentManager action