Next YC Paper Club: Inference
Inference is no longer just: y = model.forward(x)
It has now become as complex and important as training. The difference between naive inference and well tuned could be 100X in latency and cost. So we gather some of the best researchers on SOTA i…↗
Have a little writing app I'm cooking that's designed just for my workflow. As you zoom out, every card flips to a one line summary so you can quickly scan and eval the argument one level up.
Using Ollama local models to make these so they're quick and free. So simple, so useful.↗
Open WebUI is a user-friendly, self-hosted web interface for interacting with LLMs, supporting providers like Ollama and the OpenAI API. It provides a chat-style UI with features such as RAG and optional MCP integration.↗
Build your own personal assistant with @openclaw
and Ollama using your models!
ollama launch clawdbot
Thank you for building something amazing @steipete!↗