What is Deep Video Portraits?

Deep Video Portraits is an AI tool that enables facial reenactment in video content. It uses machine learning to map facial expressions and movements from a source video or performance onto a target video, allowing you to transfer expressions between faces with reasonable accuracy. The tool is developed by Stanford's graphics lab and works by analysing facial geometry and movement patterns. It's primarily useful for video editors, content creators, and researchers who need to modify facial performances in existing footage. The freemium model means you can experiment with the basic functionality without paying upfront, though advanced features or higher-resolution processing may require a subscription.

Key Features

Facial expression transfer

Map expressions from one video performance onto another person's face

Expression analysis

Captures and analyses detailed facial movements and geometry

Video-to-video mapping

Works with existing video footage rather than requiring new recordings

Real-time preview

See results as you adjust parameters

Multiple output formats

Export edited videos in common video codecs

Pros & Cons

Advantages

  • Avoids the need to re-shoot scenes if an actor's performance needs adjustment
  • Research-backed technology from a respected institution with solid technical foundations
  • Free tier lets you test the tool without commitment before upgrading
  • Useful for both professional video production and creative experimentation

Limitations

  • Results quality depends heavily on video resolution, lighting, and facial angle; poor footage will produce worse output
  • Processing can be computationally intensive and slow compared to simpler video editing tasks
  • Limited documentation available for end users; the tool originated as research software rather than a commercial product

Use Cases

Correcting an actor's expression in a single take without reshooting

Transferring a stunt performer's expressions onto an actor's face for safety-critical scenes

Creative effects for music videos or artistic projects

Researching facial animation and performance capture techniques