How a Transformer Reads Text

A Transformer reads all words together and looks for relationships between them not word by word.

This is a simplified learning demo, not the exact math used inside real Transformers.

Interactive Playground

Input Sentence

What's Happening

Press Read Text to tokenize your sentence, then tap any word to see its relationships.

Relationship Scores

Simple learning relationships, not real model attention

Live Visualization

Tokens will appear here. Tap a word to see how it relates to the rest of the sentence.

💡

Key Takeaway

A Transformer does not read text like a simple left-to-right scanner. It looks across the sentence to understand how words relate.

A pronoun like "it" is understood by checking which nouns appeared earlier the model sees the whole sentence at once.