developer_uid: richhx
submission_id: chaiml-ssnew-v5-dpo-lr5_20359_v2
model_name: chaiml-ssnew-v5-dpo-lr5_20359_v2
model_group: ChaiML/ssnew-v5-dpo-lr5e
status: torndown
timestamp: 2026-02-07T20:58:46+00:00
num_battles: 6589
num_wins: 3292
celo_rating: 1319.72
family_friendly_score: 0.46940000000000004
family_friendly_standard_error: 0.0070578132590767804
submission_type: basic
model_repo: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-W4A16-G128-AutoRound
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 64
reward_model: default
display_name: chaiml-ssnew-v5-dpo-lr5_20359_v2
ineligible_reason: model is not deployable
is_internal_developer: True
language_model: ChaiML/ssnew-v5-dpo-lr5e6b01-lora-W4A16-G128-AutoRound
model_size: 24B
ranking_group: single
us_pacific_date: 2026-01-07
win_ratio: 0.4996205797541357
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '\n', '####', 'You:'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': 'You: {message}\n', 'response_template': '####\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.13s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-ssnew-v5-dpo-lr5-20359-v2
Waiting for inference service chaiml-ssnew-v5-dpo-lr5-20359-v2 to be ready
Inference service chaiml-ssnew-v5-dpo-lr5-20359-v2 ready after 281.34265661239624s
Pipeline stage VLLMDeployer completed in 281.91s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.788670301437378s
Received healthy response to inference request in 1.4360265731811523s
Received healthy response to inference request in 1.7156434059143066s
Received healthy response to inference request in 1.4689667224884033s
Received healthy response to inference request in 1.6064794063568115s
Received healthy response to inference request in 1.8143811225891113s
Received healthy response to inference request in 1.4685850143432617s
Received healthy response to inference request in 1.5247197151184082s
Received healthy response to inference request in 1.7426283359527588s
Received healthy response to inference request in 1.4009473323822021s
Received healthy response to inference request in 1.5404138565063477s
Received healthy response to inference request in 1.8224036693572998s
Received healthy response to inference request in 1.483506679534912s
Received healthy response to inference request in 1.5590441226959229s
Received healthy response to inference request in 1.4989628791809082s
Received healthy response to inference request in 1.423454999923706s
Received healthy response to inference request in 1.4519422054290771s
Received healthy response to inference request in 1.8658349514007568s
Received healthy response to inference request in 1.5887587070465088s
Received healthy response to inference request in 1.5950369834899902s
Received healthy response to inference request in 1.9112212657928467s
Received healthy response to inference request in 1.4162263870239258s
Received healthy response to inference request in 1.4690957069396973s
Received healthy response to inference request in 1.6462674140930176s
Received healthy response to inference request in 1.4549736976623535s
Received healthy response to inference request in 1.5622379779815674s
Received healthy response to inference request in 1.6646091938018799s
Received healthy response to inference request in 1.5083179473876953s
Received healthy response to inference request in 1.513554573059082s
Received healthy response to inference request in 1.7040767669677734s
30 requests
0 failed requests
5th percentile: 1.4194792628288269
10th percentile: 1.4347694158554076
20th percentile: 1.46586275100708
30th percentile: 1.4791833877563476
40th percentile: 1.5114599227905274
50th percentile: 1.5497289896011353
60th percentile: 1.5912700176239014
70th percentile: 1.6517699480056762
80th percentile: 1.7210403919219972
90th percentile: 1.8151833772659303
95th percentile: 1.846290874481201
99th percentile: 1.8980592346191407
mean time: 1.588232930501302
Pipeline stage StressChecker completed in 50.39s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.57s
Shutdown handler de-registered
chaiml-ssnew-v5-dpo-lr5_20359_v2 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2527.03s
Shutdown handler de-registered
chaiml-ssnew-v5-dpo-lr5_20359_v2 status is now protected due to ABTestQueueItem
chaiml-ssnew-v5-dpo-lr5_20359_v2 status is now inactive due to ABTestQueueItem
chaiml-ssnew-v5-dpo-lr5_20359_v2 status is now torndown due to DeploymentManager action