Magnitude Launches Self-Compiling Inference Engine for Agents, Claiming Up to 2x Speed Over llama.cpp

Magnitude, a Y Combinator-backed startup founded by Tom Greenwald and Anders Lie, has released an open-source inference engine that automatically optimizes itself for the specific hardware it runs on, claiming performance improvements of up to 2x compared to llama.cpp.