The lead
Read any research paper at your level.
Paper2Lab explains every section three ways, from new-to-this to expert, and pins each explanation to the sentence in the paper it came from.
Plate I. The reader, workingdrag the level
Vaswani et al., Attention Is All You Need§ 3.2
Key terms, briefly explained
Paper2Lab explains
The paper stays on the page. The help goes in the margin.
Excerpts quoted word for word. Text between them is left out […].
Every claim shows its quote.
Beside every quote, one of two marks
Found word for word in the PDF. The quote links to its page, so you can read it in context.
Couldn't find this exact wording in the PDF. A quote that fails the check stays on the page, marked, never hidden.
A small shelf, read closely.
- arXiv:____.____
Your paper, next.
Paste an arXiv link or drop in a PDF. It's read once, explained section by section, and kept in this browser only. No account.
Equations you can push on.
Turn the key size up and switch the scaling off: the softmax piles all its weight on one word, which is exactly the problem the paper's √dₖ fixes.
See it in the readerPlay with itWhy divide by the square root of the key size?
How much “animal” attends to each word
- The13.1%
- animal30.2%
- didn't47.1%
- cross3.7%
- street5.9%
Scores q·k/√dk: -0.1, 0.8, 1.2, -1.4, -0.9 · softmax slope at the top word 0.249 (max 0.250)
With scaling, attention is spread out (the top word gets 47.1%), so the gradients are healthy and it can still learn.
Queries and keys are random numbers with mean 0 and variance 1, as in the paper's footnote, so a dot product of dk of them has variance dk.
Notes to the reader
Your papers stay yours
There are no accounts. Papers you add belong to your browser, through a random key in a cookie that scripts can't read. Nobody else can open, list or delete them.
About this demo
The live demo runs without an AI key, so it shows two papers explained in advance. Every feature works on them, including prepared answers to their suggested questions. Adding new papers is paused.
Made in the open
Explanations are written by AI and can be wrong; that's why each one shows its quote. The code is open source, built by Alshifa.
Pick a paper. Pick your level.