Rethinking DPO: The Role of Rejected Responses in Preference Misalignment.

Wed, 01 Jan 2025 00:00:00 +0100

Jae Hyeon Cho, JunHyeok Oh, Myunsoo Kim, Byung-Jun Lee:
Rethinking DPO: The Role of Rejected Responses in Preference Misalignment. EMNLP (Findings) 2025: 8159-8176