Tag reinforcement learning human feedback sycophancy

RLHF sycophancy is the technical term for why AI chatbots habitually agree with you – even when you are demonstrably wrong.…