Keep pulling the thread on Bin Liu & Jake Moran.
The HyperFrames Studio allows users to make visual edits through a UI, which are then translated back into code, enabling an AI agent to understand the changes via a code diff.
HeyGen's strategic focus is not on competing with cinematic video generation models like Seedance or Veo 3, or with Hollywood-style productions.
HeyGen pivoted to a code-based approach for video generation because they believe LLMs can express visual aesthetics more effectively through HTML, CSS, and JavaScript.
A one-minute launch video for Spotify was generated using the Fable 5 model by providing it with the spotify.com URL and a simple prompt.
Engineers can use a coding agent to create launch videos with HyperFrames without needing to learn traditional video editing tools like After Effects or CapCut.
The HyperFrames tool for creating AI videos from HTML is available completely for free.
HyperFrames generates videos by assembling video clips, audio, animations, and motion graphics into a codebase consisting of HTML, CSS, and JavaScript.
The HyperFrames renderer uses custom data attributes added to HTML elements to convert a codebase into a final MP4 video file.
HeyGen has released a fully open-source 'skill' for creating videos within the HyperFrames open-source project.
The open-source HyperFrames 'website to video' skill guides an AI agent through a seven-step process to convert a website into a video.
HyperFrames uses a local text-to-speech (TTS) model, which an AI agent can download and run, to generate audio for videos for free.
AI agents using HyperFrames can connect to external services like HeyGen and ElevenLabs for text-to-speech and image generation.