#direct preference optimization
Direct Preference Optimization: 2 AI articles covering direct preference optimization news, analysis, and research
Articles
PRO-Step: Step-level Process Reward Optimization for Retrieval⭐9
PRO-STEP: A novel framework optimizing step-level retrieval and reasoning in RAG via process reward models and preference optimization, improving accuracy acros...
Auditing Preference Biases and Fine-Tuning Language Models with⭐9
Learn to audit preference biases, fine-tune language models with DPO on Anthropic HH-RLHF using TRL and LoRA, and evaluate reward accuracy and length bias.