The problem#

Every lesson starts as messy thinking — me, talking it out, circling back, saying the good line twice in two different ways. The lesson is in the audio. The screen is just my face.

What makes a lesson land is the layer above that: a board that names the idea, text that holds the key phrase while I talk over it, a visual that shows the thing instead of describing it. Building that layer by hand is the slow part, and it's the part I'd skip when I was busy.

So I wanted a copilot that could take the messy spoken version and hand back structure: the board, the tightened narration, the visual — with the meaning intact.

How does it work?#

talking-head recording → whisper transcript → LLM paraphrase → board copy → truth-check → motion templates → ffmpeg render → review → publish

Six moving parts, one direction of travel: from rambling audio to a rendered explainer.

recording
The talking-head take — messy on purpose. Thinking out loud is allowed.
whisper
Transcription. The recording becomes text the rest of the system can work on.
paraphrase
An LLM tightens the narration to the point it was making, without adding claims.
board_copy
The words that go on screen: short, plain, in the order the lesson needs them.
truth_check
Board copy is checked back against the transcript, so the visuals can't outrun what I said.
motion_templates
The look: reusable templates that animate text and shapes so every video matches.
ffmpeg
Renders the boards and the audio into the finished file.

The value isn't the chat. It's that the output arrives already shaped like a video: boards in order, narration cut down, nothing left to interpret before the render.

What did I build?#

  1. A transcription layer. Whisper turns the take into text, so the thinking stops being stuck in audio.
  2. A paraphrase layer. The narration gets tightened to the point — the ums, the circling back and the two-attempts-at-one-sentence problem disappear.
  3. A board layer. Short on-screen copy and visuals, generated in the order the lesson needs them.
  4. A truth-check. Board copy and paraphrase are measured against the transcript, so the video can't claim more than the recording did.
  5. A render pipeline. Motion templates plus FFmpeg turn the boards into an animated explainer without an editing session.

Turn ambiguity into structure.

The whole job of the copilot, in four words.

Before and after#

StepBy handThrough the copilot
Find the lessonRe-listen to the whole recording and pick the lineTranscript in hand, the key lines are visible in text
Write the boardType the copy, lay it out, get the hierarchy rightBoard copy drafted from the recording, then reviewed
Tighten the narrationRe-record, or leave the ramble inParaphrased to the point, checked against what was actually said
Animate itKeyframe every board in an editorMotion templates animate the boards; FFmpeg renders the file

None of those steps is hard on its own. Together they were the reason videos didn't go out.

Technical depth#

  • Whisper
  • LLM paraphrase
  • FFmpeg
  • motion templates
  • truth-check

The published path is speech-first: the recording is the input, not a photo of a whiteboard. That keeps the failure surface small — one transcript, one paraphrase, one set of templates, one render.

Because the look lives in templates, the visual quality is consistent by construction: a new video inherits the same type, timing and layout rules as the last one.

Production readiness#

An explainer can fail in a way nothing catches automatically: technically clean, and wrong about what I said. The safeguards aim straight at that.

  1. A truth-check on every board. The visuals are checked against what was actually said, so a paraphrase can't become a new claim.
  2. Templates, not one-off edits. The same motion rules apply to every video, which is what makes five a week repeatable instead of heroic.
  3. A review before the render. Boards are read by a person while they're still cheap to change.
  4. Honest versioning. The render on show is labelled v0. It ships weekly; the look is still moving.

There's no scoreboard for taste, so the safeguard is sequencing: cheap to change first (copy), expensive to change last (render).

The result#

Roughly one hour of talking-head video turns into five whiteboard videos shipped per week. The same lesson I'd have described, now shown on the screen.

Whiteboard Copilot render: learn why poses work

Render: “learn why poses work”

Whiteboard Copilot render: your vibe sets their mood

Render: “your vibe sets their mood”

Watch a render (v0) ↗

30-second walkthrough#

Drop video 30-second before/during/after. Before (0–6s): the messy recording. During (6–22s): transcript, paraphrase, grouping, boards. After (22–30s): the finished whiteboard explainer.

Why this matters to an employer#

AI UX, not AI chat

The output is a finished artefact with a shape, not a wall of text to read.

Multimodal workflows

Audio becomes text, text becomes boards, boards become video — each step with something a person can check.

Human-AI collaboration

The machine drafts and renders; the person decides what's true and what ships.

Information architecture

Deciding what goes on the board, in what order, is the same skill as structuring a page or a product.

Automation around messy inputs

The input is unstructured thinking. Getting structure out the other end is the whole trick.

FAQ#

Is this a chatbot?
No. There's no conversation to babysit — a recording goes in and a structured, rendered explainer comes out.
Does the AI write the lesson?
It tightens the narration and drafts the on-screen copy. The lesson is mine; the paraphrase is checked against what I actually said, so the boards can't invent a claim.
What is it built on?
Whisper for transcription, an LLM for the paraphrase and board copy, motion templates for the look, FFmpeg for the render.
How much does it produce?
One hour of talking-head video becomes five whiteboard videos shipped per week.
Is it finished?
No. The render on show is v0 — in production weekly, with the look still being refined.