31/32proof of conceptGenerative Video
Video Generator
Turns a one-line brief into a short film with generated shots, narration and captions.
What it solves
A short film needs a script, visuals, a voice and an edit. This runs all four from a one-line brief.
How it runs
Six steps, input to output
Goes inA one-line brief
- 01
Brief
One line describing the film.
- 02
Shot list
Claude writes the script shot by shot.
- 03
Opening stills
Flux generates one still for each shot.
- 04
Motion
Kling animates each still into a clip.
- 05
Narration
MiniMax speaks the voiceover.
- 06
Assembly
ffmpeg fits each clip to its voiceover, burns the captions and joins the shots.
Comes outOne captioned mp4 with narration
What it does
Claude writes the shot list, fal.ai generates each opening still and animates it, MiniMax speaks the narration, and ffmpeg fits every clip to its voiceover, burns captions and stitches the shots into one mp4.
Three decisions
What shaped the build
The script comes first
Claude writes the whole shot list before any image is generated, so every later stage works from the same plan.
Every shot starts as a still
Each shot gets an opening still, and the video model animates that still.
The voiceover sets the timing
Clips are fitted to their narration, then captioned and stitched into one file.
Built with
8 parts
- Claude
- shot-by-shot script
- fal.ai client
- model gateway
- Flux
- opening still per shot
- Kling
- image to video
- MiniMax TTS
- narration
- ffmpeg · ffprobe
- fit · caption · concat
- Express
- portal server
- Node.js
- pipeline runtime