#reward modeling

Auditing Preference Biases and Fine-Tuning Language Models with⭐9

Learn to audit preference biases, fine-tune language models with DPO on Anthropic HH-RLHF using TRL and LoRA, and evaluate reward accuracy and length bias.