Rethinking DPO: The Role of Rejected Responses in Preference Misalignment.

Sun, 01 Jun 2025 01:00:00 +0200

Jay Hyeon Cho, JunHyeok Oh, Myunsoo Kim, Byung-Jun Lee:
Rethinking DPO: The Role of Rejected Responses in Preference Misalignment. CoRR abs/2506.12725 (2025)