RLHF

RLHF is the training stage that turns a raw text predictor into a helpful assistant: humans rate candidate answers, a reward model learns those preferences, and the language model is tuned toward responses people prefer. It is the main reason chatbots follow instructions and refuse harmful requests, and its limits are why jailbreaks exist: the guardrails are learned preferences, not hard rules.