#preference alignment

Don't Blame the Preferences: Reconsidering How SycophancyNEW⭐8

Sycophancy in LLMs is largely established during supervised fine-tuning, not preference alignment, suggesting interventions must target earlier training stages ...