Auditing Preference Biases and Fine-Tuning Language Models with Direct Preference Optimization on Anthropic HHNEW⭐9

Learn to audit preference biases, fine-tune language models with DPO on Anthropic HH-RLHF using TRL and LoRA, and evaluate reward accuracy and length bias.