Open-Source Engine Brings 125-Billion-Parameter AI Model to Consumer Gaming GPUs
Sign in✓ Signed in
Strata, an MIT-licensed open-source inference engine, now enables users to run Qwen3.8-Flash-Next—a 125-billion-parameter model—on consumer-grade gaming graphics cards with as little as 12 GB of VRAM. The achievement addresses a fundamental barrier to local AI deployment: most modern large language models require datacenter-scale infrastructure or expensive cloud APIs. With Strata, developers and researchers can now operate sophisticated AI capabilities entirely on their machines, offline and private.
Continue reading
The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in✓ Signed in — this article isn’t included in your current plan.
Unlocking the full article...