French AI infrastructure startup Kog has introduced a technical preview of Kog Inference Engine, claiming that standard data-center GPUs can deliver the low-latency decoding needed for sequential AI-agent workflows. The company reports 3,000 output tokens per second per request on eight AMD Instinct MI300X GPUs and 2,100 on eight NVIDIA H200 GPUs.
Continue reading
The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in✓ Signed in — this article isn’t included in your current plan.
Unlocking the full article...
Contact us
Questions, corrections, or ideas? Send us a message here. We aim to reply by email within 24 hours.
Thank you. Your message has been sent. We aim to reply by email within 24 hours.Please enter your email address and a message.We could not send your message. Please try again in a little while.