This is a heavily interactive web application, and JavaScript is required. Simple HTML interfaces are possible, but that is not what this is.
Post
Tim Kellogg
timkellogg.me
did:plc:ckaz32jwl6t2cno6fmuw2nhn
it’s not hidden. vllm/ollama is configured to parse & process it (stop the loop)
this guy is spinning the model up directly from pytorch/transformers so he can run his own loop & insert the prefix himself
2025-02-06T14:11:27.256Z