Breaking

Alibaba Adds Music-Synced Dance Generation to Wan Video

July 3, 2026 at 02:03 EDT

Media Generation
Foundation Models

Alibaba on July 3, 2026 added a new feature called "Music to Dance" to its video-generation platform Wan Video, generating dance videos synchronized to a song's rhythm from a character image and a track.

Tongyi Lab · Alibaba Wan

"Music to Dance" turns one photo into a beat-synced dance video

Wan's new feature generates a character dancing in time with any song from a single still image — extending the open-source Wan2.2-S2V audio-driven video model to general users.

dance styles: Street, Tap, Latin, K-Pop, Chinese Classical

14B

parameters in the underlying Wan2.2-S2V model

720P

output up to 720P at 24 fps

How it works

Character image

upload one still

→

Add a song

pick a dance style

→

Beat-synced dance video

rhythm-matched motion

Wan2.2-S2V-14B benchmarks

Rated top-class or on par with comparable models across quality, identity, and sync.

15.66

FID · image quality

129.57

FVD · video quality

0.734

SSIM · structure

0.677

CSIM · identity

Praised for

Physical naturalness of complex motion (skating, bowl-balancing)
Accessories that move with the dance's physics
Character consistency and smooth rotations
Open-source code and weights

Open challenges

Lag or inconsistency in fast, large-amplitude motion
Background artifacts across S2V-family models
Feature is very recent — pricing and limits unspecified
Web trial only; dedicated app "coming soon"

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.