Openjutsu

An open-source, Genjutsu-style character and object swap for video. Drop a video and a character photo, press Generate, and the main person in the video is replaced by your character. Or change their hair or clothes, remove something, or put them somewhere else. The camera, cuts, motion and soundtrack stay. Everything runs on open weights on your own GPU: MiniMax H3 for the video, SAM 3.1 to track people, and Qwen3-VL 8B to describe the pictures and shots.

The app is a small Next.js front end over a ComfyUI workflow. It uses @comfyorg/sdk, following Comfy's comfy-reshoot reference app.

https://github.com/user-attachments/assets/2d8d763a-1764-49a6-9116-d6d1be661ff6

Advanced: several people, pick who becomes who	Object swap: paint where it goes
From picture: a new look and place from one picture	Post-processing: fix faces

From picture → Relight: new light in the same pass

First visit: visual describer

The welcome page lets you choose the vision-language model that describes pictures and video frames and writes prompts. Qwen3-VL 8B INT8 remains the default; Qwen3-VL 4B FP8 and Gemma 4 E2B INT8 are smaller alternatives. Install a compatible single-file model including its vision weights in ComfyUI/models/text_encoders, then press Refresh models. Other installed models can be selected if they support image/video input and text generation through ComfyUI's CLIPLoader and Generate Text nodes. Text-only models and files requiring a different loader are unsuitable.

Choose according to available VRAM and leave room for image/video context and working memory; file size is not a VRAM requirement, and H3 generation has separate memory needs. Your selection is saved in this browser and used for swaps, prompt descriptions and Find people. Reopen Welcome & models to change it, or use Visual describer under Model components. Alternative describers may change prompt quality and person matching. Set up later opens the editor; generation still checks the required files. The separate H3 text encoder remains unchanged.

Modes

• Simple motion transfer: available. One character replaces the main person (the one who fills the most of the frame). Runs workflows/simple.api.json, exported from H3 One-Click Single Swap (DMAD 6 step).json.
• Advanced motion transfer: available. 1–4 characters, each with an optional role; every tracked person is matched to a role per shot, and people without a character stay untouched. Runs workflows/advanced.api.json, exported from H3 One-Click Advanced Swap (DMAD 6 step).json; One pass per person (two characters) runs workflows/advanced_maxq.api.json.
• Object swap: available. Change what SAM tracks (hair, a jacket, a car) into what you describe or show in a picture; Remove it; or change the Background around it (person stays). Only that area is regenerated. Runs workflows/object.api.json, exported from H3 One-Click Object Swap (DMAD 6 step).json.
• From picture (under Object swap): FLUX prepares the character in the raw video frame's pose and body cut while keeping the character picture's background. Review or regenerate the image, then choose Use this image to set the video length, video and motion-reference resolutions, models, LoRAs, steps and seed. SolarRenderer defaults to four steps with a selectable rank-384 or rank-64 four-step/control pair and supports up to 15 seconds, like the native H3 renderer. SolarRenderer clips longer than six seconds can take considerably longer to render, especially at higher resolutions; see the workflow requirements for the extended-silence node fix. Both LoRA file pickers support models/loras and its subfolders. Use this image also has the visual describer watch the part and write what happens (actions, held objects, expressions), then rewrite it for the prepared picture; check and edit that video description before rendering. Render video reuses the saved preview with normal-map motion guidance, the video description and the source soundtrack, in one clip without a context loop. H3 rounds the requested length down to its valid frame grid. Relight (off by default) changes the light in the same FLUX pass: pick one of seventeen looks, each shown with an example picture, or describe your own light. FLUX then sees only your picture, and the Qwen 3.5 9B prompt upsampler reads the pose from the video frame. Magenta club and Teal lasers mostly recolour the background. Relight the video's own person skips the character picture: FLUX relights the video frame itself, keeping its person, pose and setting. See the workflow requirements.

This is the beginning of the README. Read the rest at the original. Read the full README ↗