How to Project a 3D Mesh onto an Image？

[AlanConwayChen]

Hello, I'm new to the SOFA framework. I have some basic questions and I'm seeking advice from everyone.
When working with a set of three-dimensional point coordinates on a 3D mesh model and their corresponding two-dimensional pixel coordinates, I'm curious if SOFA offers a mechanism akin to PnP (Perspective-n-Point) for solving the pose. This mechanism should be capable of projecting the deformed 3D mesh onto an image, similar to the provided image.

Additionally, I would appreciate guidance on which modules to explore in order to achieve an augmented reality effect.
Thank you for your time!

[bakpaul]

Nothing exists that enables such thing to be done directly.
The rendering is done through OpenGL, so you can get the matric Intrinsic and Extrinsic parameters by looking at the camera position and the interinsic in the openGL code itself. Some codes have been produced here to use OpenCV inside SOFA, enabeling to reprojet an image in 3D inside the scene and biding some registration methods.
Other attempts at using OpenCV with sofa have been made but through 3rd party framework, but this is not currently open source.

[AlanConwayChen]

Thank you for your response regarding this problem. While some of the concepts about OpenGL are currently beyond my grasp, I am willing to further my understanding through continued learning.
I appreciate your guidance and the time you've taken to assist me!