Dongyoung Kim, Kimin Lee, Jinwoo Shin, Jaehyung Kim: Spread Preference Annotation: Direct Preference Judgment for Efficient LLM Alignment. ICLR 2025