How to Get Better Eyes?

[Shahfahad7866]

Hi friends, I am back with another noob question. How to get better eyes in output video. Most of the time, the eyes are half closed or a little bit off-shape. how to fix this? Please advise.

[RoopUser]

She's a looker. ;)

[Shahfahad7866]

i don't get u

[CassySpencer]

Is there a way to change the direction of the eyes? Sometimes they're looking in odd directions and I would like to be able to modify where they are looking.

[ItsMeTho]

I've had this. Inside Roop nothing much you can do (I think). What I did is make the eyes more clear in Photoshop. Upon closer inspection I noticed for instance the reflection in the right eye made it(for an algorithm) difficult to 'read'. Things that seem obvious for us can be hard for the machine to see.
After that I also cleaned up the iris and I moved them around a bit and test in Roop what that does. It worked to nudge the eyes a bit that way and catch more camera.

[Shahfahad7866]

wao, but can share more info on how you adjust eyes in a video, or do you make changes in the input image?

[ItsMeTho]

Yes you have to change the input image. in Roop u can't do anything. All options give pretty much the same result. I think it's the swap that goes wrong and the post-processing filters can't fix it.
The steps I mentioned in my comments is all Photoshop. Same with hair actually. If you have an input image with hair covering the forehead, you might have to clean that up first.

Idk any steps that 'work', bc this thing with the eyes shouldn't happen in the first place. But my logic was that if the eyes come out looking left, the iris in the input image should go right to compensate. Didn't translate just like that.. so I just experimented in PS to see what could make Roop pick up the input image correctly. The iris part wasn't good so I took better iris from another picture (same person), that also fixed a weird reflection that I think was a hindrance for Roop. I also made sure the white area was clear & bright enough, and I moved the iris left and right a bit. Trial & error and you have to do it without changing the person (sometimes can happen quickly).

Best is to take another picture (doesn't always help)

Ultimately, all AI is trained with (hopefully) curated material and some input with work better then other. the Photo AI upscale/enhance app from Topaz has a face-enhancement option.. with default settings it returns (imo) unusable plastic. Just wild how bad it is really.. I have to soften my source in Photoshop first, add some grain, then this face model suddenly picks up the image in the way that (I guess) it was trained bc I get 6x upscaled, sharp, realistic results.