Inspired by @typesafeai , here is a Jev-compatible public API to play with It runs a comparable open model (Qwen3.6-35B-A3B), and just uses SGLang radix cache to preserve the prefill reuse / really fast parallel systemone generation - 64 tasks in <1s. github.com/ekzhang/openje…↗
@ekzhang1
Eric Zhang · 23,158 followers
Computer systems person, interaction designer. @thinkymachines prev founding eng @modal → dreams of: a simpler, more honest, more human sort of software
1 bookmark
View all →