Dual-Difficulty Curriculum Learning for Direct Preference Optimization
Researchers introduced a two-dimensional curriculum learning framework that categorizes alignment difficulty by prompt complexity and pairwise distinguishability to optimize direct preference optimization.