interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came awa…↗

I predict that by the end of 2025 neural nets will: - have human-level situational awareness (understand that they're NNs, how their actions interface with the world, etc) - beat any human at writing down effective multi-step real-world plans - do better than most peer reviewers↗

🗄️🗄️Will the next generation of LLMs have native data structures for storing insights? Pre-LLM era research has some interesting ideas here. Two of my favorite, both exactly what they sound like: - Stack-Augmented Recurrent NNs - Neural Turing Machine More 👇↗