MoE

MoE is a model architecture that splits a neural network into many specialist sub-networks and routes each input through only a few of them, so a model can have enormous total capacity while spending modest compute per query. Many frontier models use it. The term shows up in vendor claims and model cards, and knowing it helps you read AI marketing critically instead of treating parameter counts as a quality score.