This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Sung Kim
sungkim.bsky.social
did:plc:cq4gg3odxz2pzmkx2fuac3u3
They have found that LLMs' capacity density grows EXPONENTIALLY over time!
Based on evaluation, they are seeing capability density DOUBLES every 3.3 months, which implies that in 3.3 months, we can achieve performance comparable to the sota LLM using a model with only HALF the number of parameters!
2024-12-08T03:16:05.853Z