developer_uid: richhx
submission_id: chaiml-csfs-v3-3-dpo-lr_86819_v2
model_name: chaiml-csfs-v3-3-dpo-lr_86819_v2
model_group: ChaiML/csfs-v3-3-dpo-lr5
status: protected
timestamp: 2026-01-10T17:42:52+00:00
num_battles: 6425
num_wins: 3186
celo_rating: 1285.09
family_friendly_score: 0.49939999999999996
family_friendly_standard_error: 0.0070710627206948175
submission_type: basic
model_repo: ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-W4A16-G128-AutoRound
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 64
reward_model: default
display_name: chaiml-csfs-v3-3-dpo-lr_86819_v2
ineligible_reason: model is not deployable
is_internal_developer: True
language_model: ChaiML/csfs-v3-3-dpo-lr5e6b01-lora-W4A16-G128-AutoRound
model_size: 24B
ranking_group: single
us_pacific_date: 2026-01-07
win_ratio: 0.49587548638132295
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['You:', '</s>', '####', '\n'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': 'You: {message}\n', 'response_template': '####\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.13s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-csfs-v3-3-dpo-lr-86819-v2
Waiting for inference service chaiml-csfs-v3-3-dpo-lr-86819-v2 to be ready
Inference service chaiml-csfs-v3-3-dpo-lr-86819-v2 ready after 241.76113629341125s
Pipeline stage VLLMDeployer completed in 242.28s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.5432112216949463s
Received healthy response to inference request in 1.4598212242126465s
Received healthy response to inference request in 1.5143139362335205s
Received healthy response to inference request in 1.5223445892333984s
Received healthy response to inference request in 1.4672906398773193s
Received healthy response to inference request in 1.5927691459655762s
Received healthy response to inference request in 1.4104607105255127s
Received healthy response to inference request in 1.54850172996521s
Received healthy response to inference request in 1.4174530506134033s
Received healthy response to inference request in 1.4581232070922852s
Received healthy response to inference request in 1.4270198345184326s
Received healthy response to inference request in 1.443108320236206s
Received healthy response to inference request in 1.4051568508148193s
Received healthy response to inference request in 1.5204246044158936s
Received healthy response to inference request in 1.5982913970947266s
Received healthy response to inference request in 1.7043335437774658s
Received healthy response to inference request in 1.924128532409668s
Received healthy response to inference request in 1.4565646648406982s
Received healthy response to inference request in 1.9378151893615723s
Received healthy response to inference request in 1.7042818069458008s
Received healthy response to inference request in 1.5276291370391846s
Received healthy response to inference request in 1.4892053604125977s
Received healthy response to inference request in 1.5675504207611084s
Received healthy response to inference request in 1.6346642971038818s
Received healthy response to inference request in 1.5631604194641113s
Received healthy response to inference request in 1.7043063640594482s
Received healthy response to inference request in 1.5790233612060547s
Received healthy response to inference request in 1.430544376373291s
Received healthy response to inference request in 1.478583812713623s
Received healthy response to inference request in 1.5966804027557373s
30 requests
0 failed requests
5th percentile: 1.4136072635650634
10th percentile: 1.4260631561279298
20th percentile: 1.4538733959197998
30th percentile: 1.4650498151779174
40th percentile: 1.5042705059051513
50th percentile: 1.5249868631362915
60th percentile: 1.5543652057647706
70th percentile: 1.5831470966339112
80th percentile: 1.6055659770965578
90th percentile: 1.70430908203125
95th percentile: 1.8252207875251765
99th percentile: 1.93384605884552
mean time: 1.5542254050572712
Pipeline stage StressChecker completed in 49.01s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
chaiml-csfs-v3-3-dpo-lr_86819_v2 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2731.33s
Shutdown handler de-registered
chaiml-csfs-v3-3-dpo-lr_86819_v2 status is now protected due to ABTestQueueItem