#36

Proposal: auto-zoom on clicks, voiceover narration, and a visual editor — happy to contribute them

OpenDixitRamopened 1mo ago

Hi WebReel team 👋

I've been building a tool with almost the same idea as WebReel: demos as scripts, so you re-run instead of re-shoot when the UI changes. Instead of launching it as yet another separate repo, I'd much rather contribute the parts WebReel doesn't have yet — if you're open to them.

What I've built that WebReel could use

1. Auto-zoom on clicks (camera follows the action) The camera zooms in on each click, Screen Studio style, and back out between them. Clicks close together in time are merged into one zoom so it doesn't bounce in and out.


2. Voiceover narration Each step can carry a narration line, spoken by local espeak-ng or ElevenLabs / Gemini / Mistral (API key). During recording, a step holds until its line has been said, so pacing follows the words. An LLM — or a coding agent looking at frames from the recording — can draft the lines.


3. Visual editor for the final touch A browser-based editor that opens a recording: drag zoom regions on a timeline, adjust the background frame, preview, and export MP4. Scripts get you 95% there; the editor fixes the last 5% without touching JSON.

Why it fits WebReel

WebReel's timeline already stores the cursor position for every frame plus click events with timestamps, and webreel composite re-renders from it. So:

  • auto-zoom → a compositing pass driven by the click events already in the timeline. No recorder change.
  • narration → an optional narration field on steps, an audio track at composite time, and a small recorder hook so a step can wait for its line.
  • editor → webreel edit <video> opening the raw recording + timeline and writing back to the same files.

Everything is opt-in via config.

Proposed PR order

  1. Auto-zoom ("autoZoom": true, so it doesn't clash with the existing zoom) — smallest, most visible
  2. Narration on steps + TTS providers
  3. Editor (webreel edit)

Each as its own small PR, following your code style and architecture, contributed under WebReel's Apache-2.0 license.

Would you be open to this? If yes, I'll start with auto-zoom — and I'm happy to adjust the design to whatever fits WebReel best.

Thanks for building WebReel!

Activity

0

No activity yet.