← Cybersecurity Alphabet Soup

SFT

Supervised Fine-Tuning

aihard

SFT takes a pre-trained language model and continues training it on curated example conversations so it learns a specific style, format, or domain, usually as the step before preference tuning like RLHF. For organizations, fine-tuning on internal data creates a new asset to protect: the resulting model can memorize and regurgitate fragments of its training data, so the tuned weights deserve the same sensitivity classification as the data that shaped them.

Sources

More in ai