developer_uid: richhx
submission_id: chaiml-csfs-v3-3-dpo-lr5e_937_v8
model_name: chaiml-csfs-v3-3-dpo-lr5e_937_v8
model_group: ChaiML/csfs-v3-3-dpo-lr5
status: inactive
timestamp: 2026-03-05T19:11:51+00:00
num_battles: 1045
num_wins: 492
celo_rating: 9276.65
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 64
reward_model: default
display_name: chaiml-csfs-v3-3-dpo-lr5e_937_v8
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.47081339712918663
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '####', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': 'You: {message}\n', 'response_template': '####\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
Connection pool is full, discarding connection: %s. Connection pool size: %s
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader
Waiting for job on chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader to finish
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: Using quantization_mode: fp8
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: Repo ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8 already ends in FP8. Skipping...
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: Checking if ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8 already exists in ChaiML
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: Downloading snapshot of ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8...
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: Downloaded in 12.375s
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: Processed model ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-FP8 in 15.868s
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: creating bucket guanaco-vllm-models
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/.gitattributes
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/model.safetensors.index.json
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/config.json
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/generation_config.json
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/tokenizer_config.json
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/recipe.yaml
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/special_tokens_map.json
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/tokenizer.json
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/model-00006-of-00006.safetensors
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/model-00002-of-00006.safetensors
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/model-00003-of-00006.safetensors
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/model-00001-of-00006.safetensors
chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-csfs-v3-3-dpo-lr5e-937-v8/default/model-00004-of-00006.safetensors
Job chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader completed after 73.09s with status: succeeded
Stopping job with name chaiml-csfs-v3-3-dpo-lr5e-937-v8-uploader
Pipeline stage VLLMUploader completed in 73.63s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.05s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-csfs-v3-3-dpo-lr5e-937-v8
Waiting for inference service chaiml-csfs-v3-3-dpo-lr5e-937-v8 to be ready
Inference service chaiml-csfs-v3-3-dpo-lr5e-937-v8 ready after 151.06861472129822s
Pipeline stage VLLMDeployer completed in 151.55s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.110865831375122s
Received healthy response to inference request in 2.6741943359375s
Received healthy response to inference request in 3.622793197631836s
Received healthy response to inference request in 2.7786192893981934s
Received healthy response to inference request in 3.062955856323242s
Received healthy response to inference request in 2.785914421081543s
Received healthy response to inference request in 3.462024450302124s
Received healthy response to inference request in 2.6762351989746094s
Received healthy response to inference request in 2.700287103652954s
Received healthy response to inference request in 2.755836009979248s
Received healthy response to inference request in 2.7332067489624023s
Received healthy response to inference request in 3.0655906200408936s
Received healthy response to inference request in 2.925016403198242s
Received healthy response to inference request in 2.768766403198242s
Received healthy response to inference request in 3.0212149620056152s
Received healthy response to inference request in 3.6076409816741943s
Received healthy response to inference request in 4.119033098220825s
Received healthy response to inference request in 2.681954860687256s
Received healthy response to inference request in 3.0591232776641846s
Received healthy response to inference request in 2.6660118103027344s
Received healthy response to inference request in 2.9884567260742188s
Received healthy response to inference request in 2.8561997413635254s
Received healthy response to inference request in 2.7633309364318848s
Received healthy response to inference request in 3.281404495239258s
Received healthy response to inference request in 3.2630536556243896s
Received healthy response to inference request in 2.6743316650390625s
Received healthy response to inference request in 2.7754087448120117s
Received healthy response to inference request in 2.7415831089019775s
Received healthy response to inference request in 3.0805232524871826s
Received healthy response to inference request in 3.1891918182373047s
30 requests
0 failed requests
5th percentile: 2.674256134033203
10th percentile: 2.6760448455810546
20th percentile: 2.7266228199005127
30th percentile: 2.7610824584960936
40th percentile: 2.7773350715637206
50th percentile: 2.890608072280884
60th percentile: 3.036378288269043
70th percentile: 3.07007040977478
80th percentile: 3.203964185714722
90th percentile: 3.476586103439331
95th percentile: 3.6159747004508973
99th percentile: 3.9751235270500187
mean time: 2.9963589668273927
Pipeline stage StressChecker completed in 94.15s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
Shutdown handler de-registered
chaiml-csfs-v3-3-dpo-lr5e_937_v8 status is now deployed due to DeploymentManager action
chaiml-csfs-v3-3-dpo-lr5e_937_v8 status is now inactive due to system request