developer_uid: richhx
submission_id: chaiml-ssnew-v5-dpo-lr_19068_v10
model_name: chaiml-ssnew-v5-dpo-lr_19068_v10
model_group: ChaiML/ssnew-v5-dpo-lr5e
status: inactive
timestamp: 2026-03-05T19:12:03+00:00
num_battles: 1623
num_wins: 797
celo_rating: 9275.71
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 64
reward_model: default
display_name: chaiml-ssnew-v5-dpo-lr_19068_v10
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.4910659272951325
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '</s>', 'You:', '\n'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': 'You: {message}\n', 'response_template': '####\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-ssnew-v5-dpo-lr-19068-v10-uploader
Waiting for job on chaiml-ssnew-v5-dpo-lr-19068-v10-uploader to finish
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: Using quantization_mode: fp8
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: Repo ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8 already ends in FP8. Skipping...
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: Checking if ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8 already exists in ChaiML
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: Downloading snapshot of ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8...
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: Downloaded in 12.956s
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: Processed model ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8 in 16.604s
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: creating bucket guanaco-vllm-models
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/model.safetensors.index.json
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/tokenizer_config.json
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/generation_config.json
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/special_tokens_map.json
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/config.json
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/.gitattributes
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/recipe.yaml
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/tokenizer.json
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/model-00006-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/model-00005-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/model-00002-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/model-00004-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/model-00003-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr-19068-v10-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr-19068-v10/default/model-00001-of-00006.safetensors
Job chaiml-ssnew-v5-dpo-lr-19068-v10-uploader completed after 72.83s with status: succeeded
Stopping job with name chaiml-ssnew-v5-dpo-lr-19068-v10-uploader
Pipeline stage VLLMUploader completed in 73.41s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.78s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-ssnew-v5-dpo-lr-19068-v10
Waiting for inference service chaiml-ssnew-v5-dpo-lr-19068-v10 to be ready
Unable to record family friendly update due to error: Invalid JSON input: Expecting value: line 1 column 1 (char 0)
Inference service chaiml-ssnew-v5-dpo-lr-19068-v10 ready after 150.6709430217743s
Pipeline stage VLLMDeployer completed in 151.71s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1146905422210693s
Received healthy response to inference request in 3.2669317722320557s
Received healthy response to inference request in 2.7373476028442383s
Received healthy response to inference request in 3.4277541637420654s
Received healthy response to inference request in 2.7447078227996826s
Received healthy response to inference request in 2.8393168449401855s
Received healthy response to inference request in 2.753251314163208s
Received healthy response to inference request in 3.0749688148498535s
Received healthy response to inference request in 2.693687677383423s
Received healthy response to inference request in 3.5886149406433105s
Received healthy response to inference request in 3.1052632331848145s
Received healthy response to inference request in 2.9240529537200928s
Received healthy response to inference request in 2.929396867752075s
Received healthy response to inference request in 3.1033716201782227s
Received healthy response to inference request in 2.7975635528564453s
Received healthy response to inference request in 2.7115159034729004s
Received healthy response to inference request in 3.2961411476135254s
Received healthy response to inference request in 3.219503402709961s
Received healthy response to inference request in 3.3510379791259766s
Received healthy response to inference request in 2.754629611968994s
Received healthy response to inference request in 2.88175368309021s
Received healthy response to inference request in 3.1981570720672607s
Received healthy response to inference request in 2.943138360977173s
Received healthy response to inference request in 2.918787717819214s
Received healthy response to inference request in 2.7073652744293213s
Received healthy response to inference request in 4.151868104934692s
Received healthy response to inference request in 3.377657651901245s
Received healthy response to inference request in 2.756312131881714s
Received healthy response to inference request in 2.6712141036987305s
Received healthy response to inference request in 2.852792739868164s
30 requests
0 failed requests
5th percentile: 2.699842596054077
10th percentile: 2.7111008405685424
20th percentile: 2.7515426158905028
30th percentile: 2.7851881265640257
40th percentile: 2.8701693058013915
50th percentile: 2.926724910736084
60th percentile: 3.086329936981201
70th percentile: 3.1397305011749266
80th percentile: 3.2727736473083495
90th percentile: 3.382667303085327
95th percentile: 3.5162275910377496
99th percentile: 3.9885246872901923
mean time: 3.0297598203023273
Pipeline stage StressChecker completed in 94.11s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.77s
Shutdown handler de-registered
chaiml-ssnew-v5-dpo-lr_19068_v10 status is now deployed due to DeploymentManager action
chaiml-ssnew-v5-dpo-lr_19068_v10 status is now inactive due to system request