AIEV - AI Edit Video by noti.vn
🇬🇧 English · 🇻🇳 Tiếng Việt
Automatic AI video editing. Claude acts as the director - driving HyperFrames (motion-graphics scenes built with HTML + GSAP) and Remotion (timeline assembly) - while you supervise everything through the web dashboard at http://localhost:6868.
Drop in a clip, briefly describe what you want, click "Start editing with AI" - the system transcribes, writes the editing plan, builds kinetic-typography scenes, karaoke subtitles, beat-synced zooms and timestamped sound effects, assembles the timeline and exports an MP4. The same engine also turns articles into narrated videos, cuts long videos into shorts and translates videos into other languages.
Every page of the dashboard has a Guide button in the top bar: it opens a side panel on the guide for the page you are on, with a menu to read any other section.
Features
| |
|---|
| 🎬 AI video editing | Claude analyzes the source → builds HyperFrames scenes → assembles with Remotion → MP4. Draft first, final later, every frame verified. |
| 🎞️ Video editor | Preview the edit in the browser (the real Remotion composition, no render needed) and change it on a timeline: reorder/trim/split scenes, edit karaoke words, subtitles, highlight cards, sound effects and music - or tell the AI in the side chat. Track locks, version history, export to Premiere Pro / DaVinci Resolve (XML). |
| 📰 Text to video | Paste a URL or text → the AI writes a spoken script in chunks → narration with Gemini TTS or on-device VieNeu-TTS → a video project edited by the AI. |
| ✂️ Auto cut | One long talking-head video → many shorts, split by time, by AI-picked highlights or by your prompt. Each segment becomes its own project sharing one brief. |
| 🌐 Translate video | Pulls the dialogue, translates it into the language you pick, then burns translated subtitles, dubs a new voice track, or both. |
| 🎙️ Voices | 30 Gemini preset voices (online) and VieNeu-TTS (offline, free, Vietnamese with regional accents) - the only engine that can clone your own voice from a short recording. |
| 🎨 Style Design | Brand kits (colors, fonts, logo, tone, effects) enforced 100% on every output. Type a font name and it downloads from Google Fonts with full Vietnamese diacritics. A style with a logo is stamped top-left automatically. |
| 🧩 Edit styles | 50 built-in visual languages for a single video - paper craft, ink wash, Vietnamese lacquer, kinetic typography, neo-brutalism, claymation, film noir... Editable, and you can add your own. Off by default. |
| 🖼️ AI images & illustrations | Gemini (API key) or the optional ChatGPT / Gemini web-account gateways paint backgrounds and style-matched illustrations; Remotion places every word on top, so Vietnamese text is never misspelled. |
| 🔑 Key layout | The main key sits in the top band, related keys in the bottom band, synced to what is being said. |
| 📝 Vietnamese karaoke subtitles | faster-whisper word timestamps (GPU preferred), keyword highlighting, battle-tested fixes for missing diacritics. |
| 🎨 Color grading with preview | 14 presets + manual adjustments, per-frame preview; log/HDR footage is tonemapped automatically. |
| 🔊 Sound effects & music | 86 bundled sound effects with a curated set the AI reaches for first; your own music library with mood tags and auto-ducking under speech. |
| 🏷️ Brand logos | 125 brand logos ship with the repo; a brand the script mentions that is missing is downloaded automatically (Simple Icons, then Wikidata) - logos are never drawn by AI. |
| 🧠 Skills | Production know-how as markdown, managed in the web UI, including AI-generated skills from a question form. |
| 🩺 Environment check & auto-install | One command probes FFmpeg, Chrome, Claude credentials, Python, faster-whisper and the Gemini key, then installs what it can. Also a card with one-click installs in Settings. |
| ⚡ Hardware acceleration | Auto-detects the GPU (NVENC on NVIDIA, VideoToolbox on macOS), parallel rendering, --gl angle. See CPU or GPU, step by step. |
| 🔄 One-click updates | The badge at the bottom of the sidebar shows when a new release is out; one click pulls, rebuilds and restarts. |
| 📊 Dashboard | Realtime progress (SSE), render queue, AI tokens by day and project type, AI sessions auto-resume after interruptions. |
Architecture
┌─────────────────────────────────────────────────────┐
│ Web UI (Next.js, port 6868) │
│ Dashboard · Videos/Images Project · Auto cut · │
│ Text to video · Translate video · Voices · │
│ Style Design · Edit styles · Render Queue · │
│ Assets · Sound Effects · Prompts · Skills · │
│ Settings · Connections (+ video editor, guide) │
└──────────────────────┬──────────────────────────────┘
│ REST + SSE
┌──────────────────────┴──────────────────────────────┐
│ Backend (Express, port 6869) │
│ Claude Agent SDK · Render queue · SQLite │
└──────┬──────────────────────────────┬───────────────┘
┌──────┴───────────┐ ┌─────────┴────────────┐
│ HyperFrames │ MP4 │ Remotion │
│ SCENE ENGINE │───────▶│ ASSEMBLER │
│ HTML + GSAP │ │ scene + audio + sub │
└──────────────────┘ └──────────────────────┘
Each project's meta.json is the single source of truth - the editor, the AI and the render queue all read and write it. Full API contract: docs/API.md. Production workflow + know-how: .claude/skills/.
以上为 README 的开头部分。其余内容请阅读原文。 查看完整 README ↗
