This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Lino Uruñuela
errioxa.bsky.social
did:plc:kqcsglxqf55jatuzjvkt7cyv
Is it possible to run an LLM if you have a .bin weights file?
e..g. the weights of the LLM that Chrome uses for Built-in AI are located at this path (in Linux):
~/.config/google-chrome-unstable/OptGuideOnDeviceModel/2024.9.25.2033/weights.bin (3GB)
Is there a way to run it from the command line?
2025-02-07T13:41:13.951Z