developer_uid: chai_backend_admin
submission_id: chaiml-ssnew-v5-dpo-lr5_19068_v5
model_name: chaiml-ssnew-v5-dpo-lr5_19068_v5
model_group: ChaiML/ssnew-v5-dpo-lr5e
status: inactive
timestamp: 2026-02-09T22:46:52+00:00
num_battles: 10596
num_wins: 5219
celo_rating: 1297.52
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 64
reward_model: default
display_name: chaiml-ssnew-v5-dpo-lr5_19068_v5
is_internal_developer: True
language_model: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-09
win_ratio: 0.4925443563608909
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['You:', '####', '</s>', '\n'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': 'You: {message}\n', 'response_template': '####\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader
Waiting for job on chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader to finish
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: Using quantization_mode: none
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: Downloading snapshot of ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8...
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: 
Fetching 14 files:   0%|          | 0/14 [00:00<?, ?it/s]
Fetching 14 files:   7%|▋         | 1/14 [00:00<00:03,  3.70it/s]
Fetching 14 files:  29%|██▊       | 4/14 [00:12<00:33,  3.36s/it]
Fetching 14 files:  43%|████▎     | 6/14 [00:13<00:16,  2.06s/it]
Fetching 14 files: 100%|██████████| 14/14 [00:13<00:00,  1.05it/s]
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: Downloaded in 13.408s
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: Processed model ChaiML/ssnew-v5-dpo-lr5e6b01-lora-FP8 in 22.835s
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: creating bucket guanaco-vllm-models
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/config.json
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/generation_config.json
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/.gitattributes
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/recipe.yaml
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/special_tokens_map.json
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/model.safetensors.index.json
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/tokenizer_config.json
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/tokenizer.json
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/model-00006-of-00006.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/model-00005-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/model-00001-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/model-00002-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/model-00004-of-00006.safetensors
chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-ssnew-v5-dpo-lr5-19068-v5/model-00003-of-00006.safetensors
Job chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader completed after 257.51s with status: succeeded
Stopping job with name chaiml-ssnew-v5-dpo-lr5-19068-v5-uploader
Pipeline stage VLLMUploader completed in 257.99s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-ssnew-v5-dpo-lr5-19068-v5
Waiting for inference service chaiml-ssnew-v5-dpo-lr5-19068-v5 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-ssnew-v5-dpo-lr5-19068-v5 ready after 382.53350019454956s
Pipeline stage VLLMDeployer completed in 383.29s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.8505454063415527s
Received healthy response to inference request in 2.731510639190674s
Received healthy response to inference request in 2.7087242603302s
Received healthy response to inference request in 3.044609546661377s
Received healthy response to inference request in 2.944861888885498s
Received healthy response to inference request in 2.9600741863250732s
Received healthy response to inference request in 3.227749824523926s
Received healthy response to inference request in 2.6802828311920166s
Received healthy response to inference request in 2.7601802349090576s
Received healthy response to inference request in 2.9963231086730957s
Received healthy response to inference request in 2.8455512523651123s
Received healthy response to inference request in 2.6589090824127197s
Received healthy response to inference request in 2.822277784347534s
Received healthy response to inference request in 3.2460522651672363s
Received healthy response to inference request in 2.9061806201934814s
Received healthy response to inference request in 3.2485694885253906s
Received healthy response to inference request in 2.8937177658081055s
Received healthy response to inference request in 2.781494617462158s
Received healthy response to inference request in 2.784074068069458s
Received healthy response to inference request in 2.975703001022339s
Received healthy response to inference request in 2.814620018005371s
Received healthy response to inference request in 2.812873125076294s
Received healthy response to inference request in 3.072807550430298s
Received healthy response to inference request in 2.677612543106079s
Received healthy response to inference request in 3.044717311859131s
Received healthy response to inference request in 2.722905397415161s
Received healthy response to inference request in 2.9493260383605957s
Received healthy response to inference request in 2.8243722915649414s
Received healthy response to inference request in 2.782874584197998s
Received healthy response to inference request in 3.0030837059020996s
30 requests
0 failed requests
5th percentile: 2.678814172744751
10th percentile: 2.705880117416382
20th percentile: 2.7544463157653807
30th percentile: 2.78371422290802
40th percentile: 2.819214677810669
50th percentile: 2.8480483293533325
60th percentile: 2.921653127670288
70th percentile: 2.964762830734253
80th percentile: 3.011388874053955
90th percentile: 3.0883017778396606
95th percentile: 3.2378161668777463
99th percentile: 3.247839493751526
mean time: 2.8924194812774657
Pipeline stage StressChecker completed in 89.88s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
chaiml-ssnew-v5-dpo-lr5_19068_v5 status is now deployed due to DeploymentManager action
chaiml-ssnew-v5-dpo-lr5_19068_v5 status is now inactive due to system request
chaiml-ssnew-v5-dpo-lr5_19068_v5 status is now inactive due to auto deactivation removed underperforming models