developer_uid: richhx
submission_id: chaiml-ssnew-v5-dpo-lr_19068_v11
model_name: chaiml-ssnew-v5-dpo-lr_19068_v11
model_group: ChaiML/ssnew-v5-dpo-lr5e
status: inactive
timestamp: 2026-03-06T00:57:53+00:00
num_battles: 15849
num_wins: 7768
celo_rating: 1222.68
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 64
reward_model: default
display_name: chaiml-ssnew-v5-dpo-lr_19068_v11
is_internal_developer: True
language_model: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.490125559972238
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['You:', '\n', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': 'You: {message}\n', 'response_template': '####\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-ssnew-v5-dpo-lr-19068-v11-uploader
Waiting for job on chaiml-ssnew-v5-dpo-lr-19068-v11-uploader to finish
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: Using quantization_mode: fp8
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: Downloaded in 13.067s
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: Processed model ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8 in 16.501s
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: creating bucket guanaco-vllm-models
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/.gitattributes
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/recipe.yaml
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/special_tokens_map.json
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/tokenizer_config.json
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/config.json
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/model.safetensors.index.json
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/generation_config.json
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/tokenizer.json
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/model-00006-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v11-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v11/default/model-00005-of-00006.safetensors
Job chaiml-ssnew-v5-dpo-lr-19068-v11-uploader completed after 76.12s with status: succeeded
Stopping job with name chaiml-ssnew-v5-dpo-lr-19068-v11-uploader
Pipeline stage VLLMUploader completed in 76.63s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.73s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-ssnew-v5-dpo-lr-19068-v11
Waiting for inference service chaiml-ssnew-v5-dpo-lr-19068-v11 to be ready
Inference service chaiml-ssnew-v5-dpo-lr-19068-v11 ready after 160.44213891029358s
Pipeline stage VLLMDeployer completed in 160.93s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.936047077178955s
Received healthy response to inference request in 2.891862392425537s
Received healthy response to inference request in 2.9750115871429443s
Received healthy response to inference request in 2.7213714122772217s
Received healthy response to inference request in 3.0635571479797363s
Received healthy response to inference request in 2.8220608234405518s
Received healthy response to inference request in 2.8359739780426025s
Received healthy response to inference request in 2.772037982940674s
Received healthy response to inference request in 3.4019503593444824s
Received healthy response to inference request in 3.4113287925720215s
Received healthy response to inference request in 2.9149329662323s
Received healthy response to inference request in 2.833777666091919s
Received healthy response to inference request in 3.324247360229492s
Received healthy response to inference request in 3.076368570327759s
Received healthy response to inference request in 3.0465478897094727s
Received healthy response to inference request in 2.743607521057129s
Received healthy response to inference request in 3.0701091289520264s
Received healthy response to inference request in 3.176058769226074s
Received healthy response to inference request in 2.836775779724121s
Received healthy response to inference request in 2.9385616779327393s
Received healthy response to inference request in 2.805257558822632s
Received healthy response to inference request in 2.740774631500244s
Received healthy response to inference request in 3.050976276397705s
Received healthy response to inference request in 3.0156171321868896s
Received healthy response to inference request in 3.2452914714813232s
Received healthy response to inference request in 3.4785804748535156s
Received healthy response to inference request in 3.310641050338745s
Received healthy response to inference request in 2.8125672340393066s
Received healthy response to inference request in 2.7936859130859375s
Received healthy response to inference request in 2.8812849521636963s
30 requests
0 failed requests
5th percentile: 2.7420494318008424
10th percentile: 2.7691949367523194
20th percentile: 2.8111052989959715
30th percentile: 2.8353150844573975
40th percentile: 2.887631416320801
50th percentile: 2.937304377555847
60th percentile: 3.0279894351959227
70th percentile: 3.0655227422714235
80th percentile: 3.1899053096771244
90th percentile: 3.332017660140991
95th percentile: 3.407108497619629
99th percentile: 3.4590774869918826
mean time: 2.9975621859232584
Pipeline stage StressChecker completed in 92.49s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 12.70s
Shutdown handler de-registered
chaiml-ssnew-v5-dpo-lr_19068_v11 status is now deployed due to DeploymentManager action
chaiml-ssnew-v5-dpo-lr_19068_v11 status is now inactive due to auto deactivation removed underperforming models