Next YC Paper Club: Inference Inference is no longer just: y = model.forward(x) It has now become as complex and important as training. The difference between naive inference and well tuned could be 100X in latency and cost. So we gather some of the best researchers on SOTA i…↗

Inspired by @typesafeai , here is a Jev-compatible public API to play with It runs a comparable open model (Qwen3.6-35B-A3B), and just uses SGLang radix cache to preserve the prefill reuse / really fast parallel systemone generation - 64 tasks in <1s. github.com/ekzhang/openje…↗