Reliability-Weighted Direct Preference Optimization: Penalized Weights for Robust Preference Learning
Direct Preference Optimization (DPO) treats every reported comparison as correct, yet preference data contain reversed, tied or otherwise noisy comparisons.
By Bin Luo, Param Venkat Vivek Kesireddy, Anil VallepuarXiv - stat.ML
Read the full story
Originally published by arXiv - stat.ML on Nov 2, 2026.
Comments
Sign in to join the discussion.