Decoder-only Models (GPT)
GPT is built to generate text, one token at a time. Let's watch it write.
Write it one token at a time
Pick a starting prompt, then press Next Token again and again. GPT doesn't write the whole sentence at once - it predicts the next word, adds it, and repeats.
GPT predicts one token at a time - press Next Token to watch the sentence grow.
Generation vs understanding
GPT is excellent at generating text. But if you need very accurate classification or semantic matching, an encoder-only model like BERT may be a better choice.
Where decoder-only models shine
Tap a card to see what GPT-style models do there.
- • GPT uses only a decoder.
- • GPT generates one token at a time.
- • GPT is designed for text generation.
- • GPT is widely used in chatbots and AI assistants.
- • Decoder-only models excel at creating new content.
Two models, two jobs
The previous lesson met BERT. Here's how the two compare at a glance.
GPT focuses on generating text. Instead of only understanding a sentence, it predicts the next token again and again to create complete responses.