Mux AI SDK: Durable AI Workflows for Video with Vercel Workflow Dev Kit
In this video, Victor gives a technical walkthrough of the Mux AI SDK, an open source toolkit for building AI-powered video workflows. The SDK ships with Vercel's Workflow Dev Kit integrated, which provides durable, resumable execution out of the box.
The demo covers generating summaries and tags from video transcripts, translating captions to other languages, translating audio using the Eleven Labs connector, and extracting social clips with automatic aspect ratio variants. Workflows persist across page refreshes and navigation, so long-running jobs resume exactly where they left off.
The SDK is organized into three layers.
1. Primitives give you low-level access to storyboards, VTT files, and transcripts.
2. Workflows are pre-built pipelines for tasks like summarization, tagging, and localization, and they ship with evaluations attached.
3. Connectors provide an integration layer for third-party services like Eleven Labs and Remotion.
Both the SDK and the demo application are open source. Fork either repo to get started.
Demo app:
https://nextjs-video-ai-workflows.ver...
@mux/ai Repo:
https://github.com/muxinc/ai