Symmetra works. You can write a normal TypeScript API, and it will run — really run — as thousands of Turing machines on a GPU, serving hundreds of thousands of requests per second with zero errors. The GPU can sustain up to 199 billion Turing-machine steps every second. That is a genuinely new kind of web server.
But our research surfaced one honest, important limitation, and we want to be straight about it.
Right now, the CPU is still doing essential work on every single request. We audited the code to be certain, and here is exactly what happens: when a request arrives, the server's CPU must first receive the raw network bytes, parse the HTTP, and copy the request into a special pinned-memory slot that the GPU can read over the PCIe bus. Only then does the GPU wake up and run your handler as a Turing machine. The CPU is the courier that carries every request from the network to the GPU's door.
This is why, in our tests, we had to add more CPU cores to the GPU server to get more requests per second — and yes, that is a little disappointing. It means that for lightweight endpoints, the GPU is not the bottleneck at all. It sits mostly idle, drawing near-idle power, while the CPU works flat-out shuttling network data to it. On an 8-core server we hit 207,000 requests/second; doubling to 32 cores pushed it to 483,000 — the GPU never changed, only the CPU's ability to feed it.
In plain terms: today, the CPU is a toll booth between the network and the GPU. Light requests spend all their time in the toll booth; the GPU's real power only shows when each request carries heavy computation.
The good news is twofold. First, where it matters, it already wins: when each request does real work — analytics, scoring, simulation, anything compute-heavy — the GPU takes over and delivers throughput a CPU runtime simply cannot match. Second, this limitation has a known fix. Technologies like GPUDirect and kernel-bypass networking can let the network card write directly into GPU memory, removing the CPU from the hot path entirely. That is the road ahead for Symmetra.
So: a GPU that runs your API as a Turing machine is real, it's fast, and it's honest about where it stands today. For heavy compute, it's already a breakthrough. For everything else, the CPU-to-GPU handoff is the next wall to break — and we know how.