Breaking

HeyGen Open-Sources HyperFrames, an HTML-to-Video Framework

July 1, 2026 at 13:18 EDT

Open Source
Media Generation
AI Agents

HeyGen, known for AI avatar and video generation, has open-sourced HyperFrames, a framework that lets AI agents compose videos using plain HTML, under the Apache 2.0 license. James Russo, who leads the project, will present a session titled "HTML Is All Agents Need" on Day 4 of the AI Engineer World's Fair 2026.

April 2026 · HeyGen

HyperFrames: “HTML Is All Agents Need”

HeyGen open-sources a framework that lets AI agents turn plain, annotated HTML into byte-identical, reproducible MP4 videos — one prompt, one CLI command, one rendering pipeline.

step flow: prompt → HTML → CLI render

animation runtimes via frame-adapter

100%

deterministic byte-identical output

The agent-generation flow

1 · Prompt

Agent receives a plain-language request

→

2 · HTML

Writes HTML + data-start / data-duration + GSAP

→

3 · Render

Puppeteer + FFmpeg → MP4 / WebM

Input format: how agents handle it

Two design philosophies for programmatic video, compared on agent-suitability.

Plain HTML

HyperFrames

HTML/GSAP abundant in
training data — one-shot friendly

React tree

Remotion

React component tree —
prone to first-pass errors

Taller column = easier for agents to generate correctly on the first pass

Where it shines

One prompt + one CLI command = full pipeline
Human-reviewable, explicit data-* timing
High deterministic reproducibility for agents
Short explainers, overlays, caption sync

The trade-offs

No real-time collaboration
No keyframe editor or effects graph
Headless-renderer centered
Remotion may win for large, complex projects

Presented at AI Engineer World's Fair 2026

“HTML Is All Agents Need” — James Russo, Senior Software Engineer, HeyGen

July 2 (Day 4) · 11:10 AM · Track 1 / Room 2010 · Q&A to follow.
Apache 2.0 · requires Node 22+ and FFmpeg · install prompt patterns via npx skills add heygen-com/hyperframes

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.