I’m trying to create a mask that works in real time from camera input using color thresholding. And It has been very, very challenging so far.
Here’s the thing - I try to illuminate subjects as much as possible to isolate the background. The background color of my studio is black. And you might not know it, but the hair color of East Asians like me, exactly Koreans, is very very dark, almost black. You can change their clothes to brighter one, but it is quite difficult to dye all of them. As you increase the power of lights or adjust the minimum point to fill the mask, then noise in the background increases as well.
So I made two layers and one adjusted the minimum point only to not exceed the outline visible from the camera input. The other is to inflate the white part of the mask with blur, then subtract it to the point that it does not exceed the outline set in the first layer and then combine the two. Thankfully, It was kind of successful when I tried it with still images but with videos, the noise looks unnatural sometimes it messes the edge.
Does anybody have any ideas to walk around it? Any good tools for shaping a mask? Or should I simply switch the background to green and key it out? Any suggestions would be greatly appreciated. Thank you.