Sirio BeratiInstagram

Higgsfield’s Genjustu exposed.

1:29English(auto-generated)7 segments325 words · 2 min read

Search inside any video

SavedThat transcribes your saved videos and lets you search across all of them instantly. Save this video and find any moment.

TL;DR

Learn how to use SourceX Field's Genjutsu to enhance your videos by segmenting audio and applying AI techniques for customization.

SourceX Field GenjutsuAI video enhancementaudio segmentation techniquesdepth mask applicationmesh tracking in videoCDANCE workflowopen source video toolscustom video editing

Chapters

  1. 0:00Introduction to Genjutsu
    01
  2. 0:10How Audio Segmentation Works
    02
  3. 0:30Creating Depth Masks
    03
  4. 0:50Applying Mesh Tracking
    04
  5. 1:10Final Output and Features
    05
  6. 1:20Open Source Project Overview
    06

Transcript

0:00

I open SourceX Field's Genjutsu and here's how it works. You upload your video and an AI looks at it and it segments the audio into two stems, the voice and the music. It mutes the music, then takes your voice and pitches it up by three semitones. It applies a depth mask to the video with video depth anything. It then segments the subject from the depth mask and it lays it over the original video.

0:15

A mesh mask is created at the same time and it saves it as the JSON file. The mesh tracking is then applied over your merge segmentation, covering over 478 points on the face. Then the final video, along with your inputs, goes into CDANCE. CDANCE generates it without any copyrighted IP because it cannot see who the subject is

0:33

and we've pitched up the voice. Then the output is returned and the original audio from your initial upload is put back in. And you get something like this. My ten principles that build billion dollar brands. Take notes. Now look, this took me 12 hours to figure out and I have open sourced the entire project

0:48

for free. I've even built a simple UI interface that you can use, including a skill with your favorite agent. All you need is a CDANCE enhancer API key, which is cheaper than anyone else on the market, faster, and it does not train on your data.

1:04

You can drop motion and I'll send everything over to you. You have the GitHub, the code, a tutorial. Now with this workflow, you can segment and replace anything, really, a background or an object. So customize the code as you wish with your agent. The tech stack is exactly the same. But the moral of the story, this is a million dollar workflow.

1:18

Put it to use, do something great with it, and do not forget, create without limits. This is Siri out.

1:28

This is Siri out.

Are you the creator or rights holder of this video? Request removal of this transcript.

Related Transcripts

Never lose a moment again

Save videos from YouTube, Instagram, and TikTok. Search everything that was said, and jump to the second.

Start Saving Videos - Free Trial