This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Corry Wang
corrywang.bsky.social
did:plc:zbqjiwg5jopx5qrt377ryn3h
1/4 From Andrej Kaparthy: an awesome firsthand account of the invention of the attention mechanism in LLMs, told for the first time in public
IMO the most interesting thing here is that if Dzmitry hadn’t invented attention in September 2014, someone else would’ve done it anyways a few months later
2024-12-04T05:19:48.761Z