The AI to get rid of the majority of 2D model riggers

So for the github project of kijai/ComfyUI-LivePortraitKJ to work you need visual Studio 2017 or later with build x86/264 for 2017 or later, python 3.10, pip, comfyui and all the requirements there in. To just run the project since the read out reads like you get it and compile it locally.

In short it makes the process of facial motion capture to a 2D image easier when you just have a PNG.
The long version it takes the process that the rigger does of cutting up the image and making parts that can move away by an algorithm that needs the AI only for the generated parts of the 2D image when you move. The way the others did it before this one is require AI as they already drew the parts moving and made sure how it moves is correct. The other method already existing requires a 3D model not a 2D image.

What it still leaves out i see used a lot is all the extras i see streamers use. Same thing with the extras games use in how they use the rigged models though with AI gen txt2video, img2video and video to video this will be a better method to do it since it is closest to img2video but still not with how it works.

The image below shows how it works. In short you have an image a video. As inputs and get a video as output though you also can do it in the way of webcam input. It just will take more processing to do webcam input as it will be more like streaming data instead of taking the data from a file and merging it with the color from another.

https://preview.redd.it/upwgcda484bd1.png?width=2558&format=png&auto=webp&s=edfb232a5a29d92db555cd354588bb0b99b11523