Works with

Automatic video editing with ffmpeg and screen recordings

Not every video needs animation. For raw recordings, screen recordings and talking-head clips, your agent can do the editing with ffmpeg: cut the dead space, keep the right takes, add captions. FrameJam is where you check every cut.

Facts about other tools are from their official docs and websites, as of Oct 2026. Each one links to its source, and all of them are listed under Sources.

What ffmpeg is

FFmpeg describes itself as "a complete, cross-platform solution to record, convert and stream audio and video." It runs from the command line, which makes it easy for an agent to use. Its filters include silencedetect, which logs where the audio drops below a noise level for long enough, and silenceremove, which removes silence from the beginning, middle or end of the audio. It's free software under the LGPL, with some optional parts under the GPL.

What automatic video editing with your agent looks like

Silence detection alone cuts by volume, so it keeps the retakes and the "um"s. The Clean Cut playbook works from a transcript instead:

It turns the recording into text, with whisper on your computer or a transcription service.
It finds the pauses, filler words, false starts and repeated takes.
It cuts them out tight, keeping the last take of every line, and renders the cut with ffmpeg.
It checks every cut, exports a cut list for your editor, and opens the result in FrameJam.

You watch the cut and pin the spots that are off: "this cut is too tight", "keep the first take here". The agent gets each comment with its timestamp and a frame image, fixes those cuts, and renders the next version. More on that in the review page docs, and the Claude video guide shows it on a raw YouTube intro.

Screen recordings and talking-head clips

The same goes for footage you already have. Founder Launch cuts a founder's to-camera take together with screen recordings of the product. YouTube Hook tightens the opening of a long video. Captions can be burned in with ffmpeg, and when a moment needs a graphic, the agent makes a short clip in Hyperframes or the project's own tool and overlays it.

~/Downloads/demo-raw.mov Use the FrameJam playbook "Clean Cut": remove the pauses, filler words and retakes, keep my last take of each line, and open the cut in FrameJam for review.

This works the same in Claude, ChatGPT and Cursor. Weighing this against a dedicated editor? See Descript alternatives.

Playbooks that work with ffmpeg and screen recordings

A playbook is FrameJam's method for one kind of video. Your agent follows it in whichever tool the project uses.

remove silence from video, plus filler words and retakesClean Cut: A raw recording goes in, the same video as a tight, fast-paced jump cut without pauses, fillers and retakes comes out.
edit a YouTube intro hook with AIYouTube Hook: Your intro script or recording goes in, the 20–60 second opening that keeps people watching your long video comes out.
make a founder launch video for X with AIFounder Launch: A founder talking to camera and screen recordings go in, a tight launch video for X comes out.
make YouTube Shorts with AI from talking-head clipsShow & Tell Short: Raw talking-head clips go in, a tight vertical short that shows what you talk about while you say it comes out.
edit shorts with AI, with layouts that switch as you talkDynamic Layout Short: A raw talking-head recording goes in, a vertical short that switches layout with what you say comes out.

Questions

Can ffmpeg remove silence by itself?

It can find and cut quiet stretches of audio with its silencedetect and silenceremove filters. Cutting retakes and filler words also needs a transcript, which is why the Clean Cut playbook transcribes the recording first.

Do I need to know ffmpeg?

No. Your agent writes the commands. You describe the edit in plain words and review the result in FrameJam.

Is my recording uploaded?

Not by FrameJam: it runs on your computer and keeps projects in ~/.framejam. If you pick a paid transcription service instead of local whisper, the audio goes to that service.

Can I finish the edit in my own editor?

Yes. Clean Cut can export a cut list for your editor alongside the cut video, so you can take the rough cut further in Premiere, Resolve or similar.

Why is ffmpeg required for FrameJam?

FrameJam cuts the frame thumbnails your comments point at out of the rendered video with ffmpeg. Most playbooks also use it to cut and join footage.

Guides

How to edit videos with ClaudeEdit and make videos in Claude with FrameJam: cut a raw recording, add animations, then point at the exact frames to change. With a full video walkthrough.
All guides to making videos with your AI agent

Sources

Checked on October 14, 2026. Prices and features change; the linked pages are current.

FrameJam is free, local and open source. Install it in Claude, ChatGPT or Cursor, and read how the review page works.