developer_uid: chai_backend_admin
submission_id: chaiml-csfs-v3-3-dpo-l_86358_v23
model_name: chaiml-csfs-v3-3-dpo-l_86358_v23
model_group: ChaiML/csfs-v3-3-dpo-lr5
status: torndown
timestamp: 2026-02-12T23:31:45+00:00
num_battles: 10938
num_wins: 5376
celo_rating: 1302.21
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/csfs-v3-3-dpo-lr5e6b01-lora
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 64
reward_model: default
display_name: chaiml-csfs-v3-3-dpo-l_86358_v23
is_internal_developer: True
language_model: ChaiML/csfs-v3-3-dpo-lr5e6b01-lora
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-09
win_ratio: 0.49149753154141523
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '####', 'You:', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': 'You: {message}\n', 'response_template': '####\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-csfs-v3-3-dpo-l-86358-v23-uploader
Waiting for job on chaiml-csfs-v3-3-dpo-l-86358-v23-uploader to finish
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: Using quantization_mode: none
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: Downloading snapshot of ChaiML/csfs-v3-3-dpo-lr5e6b01-lora...
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: 
Fetching 18 files:   0%|          | 0/18 [00:00<?, ?it/s]
Fetching 18 files:   6%|▌         | 1/18 [00:00<00:05,  3.21it/s]
Fetching 18 files:  11%|█         | 2/18 [00:00<00:03,  4.35it/s]
Fetching 18 files:  28%|██▊       | 5/18 [00:15<00:46,  3.61s/it]
Fetching 18 files:  33%|███▎      | 6/18 [00:15<00:33,  2.76s/it]
Fetching 18 files:  39%|███▉      | 7/18 [00:16<00:23,  2.16s/it]
Fetching 18 files:  44%|████▍     | 8/18 [00:17<00:19,  1.97s/it]
Fetching 18 files:  50%|█████     | 9/18 [00:18<00:14,  1.60s/it]
Fetching 18 files:  56%|█████▌    | 10/18 [00:18<00:10,  1.31s/it]
Fetching 18 files:  61%|██████    | 11/18 [00:18<00:06,  1.02it/s]
Fetching 18 files:  72%|███████▏  | 13/18 [00:22<00:06,  1.24s/it]
Fetching 18 files: 100%|██████████| 18/18 [00:22<00:00,  1.23s/it]
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: Downloaded in 22.240s
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: Processed model ChaiML/csfs-v3-3-dpo-lr5e6b01-lora in 39.664s
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: creating bucket guanaco-vllm-models
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/.gitattributes
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/generation_config.json
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/README.md
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/config.json
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/special_tokens_map.json
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model.safetensors.index.json
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/tokenizer_config.json
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/tokenizer.json
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00010-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00010-of-00010.safetensors
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00004-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00004-of-00010.safetensors
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00002-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00002-of-00010.safetensors
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00007-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00007-of-00010.safetensors
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00009-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00009-of-00010.safetensors
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00003-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00003-of-00010.safetensors
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00006-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00006-of-00010.safetensors
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00005-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00005-of-00010.safetensors
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00008-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00008-of-00010.safetensors
chaiml-csfs-v3-3-dpo-l-86358-v23-uploader: cp /dev/shm/model_output/model-00001-of-00010.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-l-86358-v23/model-00001-of-00010.safetensors
Job chaiml-csfs-v3-3-dpo-l-86358-v23-uploader completed after 461.56s with status: succeeded
Stopping job with name chaiml-csfs-v3-3-dpo-l-86358-v23-uploader
Pipeline stage VLLMUploader completed in 462.10s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-csfs-v3-3-dpo-l-86358-v23
Waiting for inference service chaiml-csfs-v3-3-dpo-l-86358-v23 to be ready
HTTP Request: %s %s "%s %d %s"
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service chaiml-csfs-v3-3-dpo-l-86358-v23 ready after 292.48653507232666s
Pipeline stage VLLMDeployer completed in 293.04s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.576601266860962s
Received healthy response to inference request in 2.6295487880706787s
Received healthy response to inference request in 2.2670185565948486s
Received healthy response to inference request in 2.6847455501556396s
Received healthy response to inference request in 2.186201333999634s
Received healthy response to inference request in 2.5542588233947754s
Received healthy response to inference request in 2.3451266288757324s
Received healthy response to inference request in 2.2034647464752197s
Received healthy response to inference request in 2.9317705631256104s
Received healthy response to inference request in 2.3045778274536133s
Received healthy response to inference request in 2.4311280250549316s
Received healthy response to inference request in 2.369652271270752s
Received healthy response to inference request in 2.4878904819488525s
Received healthy response to inference request in 2.3514981269836426s
Received healthy response to inference request in 2.3892440795898438s
Received healthy response to inference request in 2.1397669315338135s
Received healthy response to inference request in 2.67374324798584s
Received healthy response to inference request in 2.261908769607544s
Received healthy response to inference request in 2.195573091506958s
Received healthy response to inference request in 2.418407440185547s
Received healthy response to inference request in 2.3928656578063965s
Received healthy response to inference request in 2.2874715328216553s
Received healthy response to inference request in 2.2833189964294434s
Received healthy response to inference request in 2.7406482696533203s
Received healthy response to inference request in 2.314667224884033s
Received healthy response to inference request in 2.2781331539154053s
Received healthy response to inference request in 2.625288724899292s
Received healthy response to inference request in 2.4335267543792725s
Received healthy response to inference request in 2.759916067123413s
Received healthy response to inference request in 2.3015079498291016s
30 requests
0 failed requests
5th percentile: 2.1904186248779296
10th percentile: 2.2026755809783936
20th percentile: 2.275910234451294
30th percentile: 2.2972970247268676
40th percentile: 2.3329428672790526
50th percentile: 2.379448175430298
60th percentile: 2.4234956741333007
70th percentile: 2.507800984382629
80th percentile: 2.6261407375335692
90th percentile: 2.690335822105408
95th percentile: 2.7512455582618713
99th percentile: 2.8819327592849735
mean time: 2.4273156960805258
Pipeline stage StressChecker completed in 75.65s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.17s
Shutdown handler de-registered
chaiml-csfs-v3-3-dpo-l_86358_v23 status is now deployed due to DeploymentManager action
chaiml-csfs-v3-3-dpo-l_86358_v23 status is now inactive due to auto deactivation removed underperforming models
chaiml-csfs-v3-3-dpo-l_86358_v23 status is now torndown due to DeploymentManager action