Higgsfield’s Genjustu exposed.
Search inside any video
SavedThat transcribes your saved videos and lets you search across all of them instantly. Save this video and find any moment.
TL;DR
Learn how to use SourceX Field's Genjutsu to enhance your videos by segmenting audio and applying AI techniques for customization.
Chapters
- 0:00Introduction to Genjutsu01
- 0:10How Audio Segmentation Works02
- 0:30Creating Depth Masks03
- 0:50Applying Mesh Tracking04
- 1:10Final Output and Features05
- 1:20Open Source Project Overview06
Transcript
I open SourceX Field's Genjutsu and here's how it works. You upload your video and an AI looks at it and it segments the audio into two stems, the voice and the music. It mutes the music, then takes your voice and pitches it up by three semitones. It applies a depth mask to the video with video depth anything. It then segments the subject from the depth mask and it lays it over the original video.
A mesh mask is created at the same time and it saves it as the JSON file. The mesh tracking is then applied over your merge segmentation, covering over 478 points on the face. Then the final video, along with your inputs, goes into CDANCE. CDANCE generates it without any copyrighted IP because it cannot see who the subject is
and we've pitched up the voice. Then the output is returned and the original audio from your initial upload is put back in. And you get something like this. My ten principles that build billion dollar brands. Take notes. Now look, this took me 12 hours to figure out and I have open sourced the entire project
for free. I've even built a simple UI interface that you can use, including a skill with your favorite agent. All you need is a CDANCE enhancer API key, which is cheaper than anyone else on the market, faster, and it does not train on your data.
You can drop motion and I'll send everything over to you. You have the GitHub, the code, a tutorial. Now with this workflow, you can segment and replace anything, really, a background or an object. So customize the code as you wish with your agent. The tech stack is exactly the same. But the moral of the story, this is a million dollar workflow.
Put it to use, do something great with it, and do not forget, create without limits. This is Siri out.
This is Siri out.
Are you the creator or rights holder of this video? Request removal of this transcript.
Related Transcripts
How to make simple swaps in your videos using Higgsfield
Rourke Heath
Claude Fable 5 + Higgsfield MCP Will Make You Rich!
Higgsfield AI
Higgsfield MCP + Claude Just Changed Marketing Forever!
Higgsfield AI
Creating UI Animations with AI 🤯 @higgsfield.ai This feature is still in Beta…
John
Make Ultra Realistic AI Short Films with Fable 5 + Seedance 4K (Full Workflow)
Higgsfield AI
Comment AI for the link and guide to turn one shot into endless creative angles…
Jo Mendes
Never lose a moment again
Save videos from YouTube, Instagram, and TikTok. Search everything that was said, and jump to the second.
Start Saving Videos - Free Trial