DeepSeek Open-Sources DeepInfer Framework, Dramatically Cutting AI Inference Costs

China's DeepSeek released DeepInfer, an open-source inference framework designed to slash the compute costs of running large language models at scale. The framework, which integrates a deeply optimized inference engine and high-performance operators, powers DeepSeek's production models and is now available to the broader developer community.