Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About extract 3D landmarks from VOCA #47

Open
kuanxin opened this issue Feb 19, 2021 · 5 comments
Open

About extract 3D landmarks from VOCA #47

kuanxin opened this issue Feb 19, 2021 · 5 comments

Comments

@kuanxin
Copy link

kuanxin commented Feb 19, 2021

How to extract the 3d feature points of the obj mesh output by VOCA...><
Many thanks

@TimoBolkart
Copy link
Owner

May I ask what you intend to do with the landmarks extracted from a VOCA mesh? VOCA outputs meshes in FLAME topology which provides a much denser correspondence than just 51 / 68 landmarks.

However, if you are still interested in the landmarks, just load the FLAME landmark embedding, the FLAME mesh output from VOCA, and call the function mesh_points_by_barycentric_coordinates in here. This returns you the 3D landmarks in that mesh.

@kuanxin
Copy link
Author

kuanxin commented Feb 25, 2021

@TimoBolkart
I try to change the 68/51 landmarks of the obj face model in unity3d to achieve the animation effect that the face model is talking. I am not sure is the correct way...

Thanks for your reply! It's very helpful.

@kuanxin
Copy link
Author

kuanxin commented Mar 2, 2021

@TimoBolkart
For example, I have a 3D face model generated by DECA, how to use VOCA to make this face model lip-sync in Blender or unity3d?

Thank you

@airfri
Copy link

airfri commented Nov 22, 2021

@TimoBolkart
May I ask how to calculate the two formal parameters mesh_vertsand mesh_facesof the function mesh_points_by_barycentric_coordinates from VOCA flame mesh output?

@Hello-hubKing
Copy link

@TimoBolkart For example, I have a 3D face model generated by DECA, how to use VOCA to make this face model lip-sync in Blender or unity3d?

Thank you
I have same issue, do you resolve it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants