Liam Schoneveld

SHeaP - Self-Supervised Head Geometry Predictor - a Hugging Face Space by nlml Upload an image or video to get a 3D mesh overlay showing head geometry. The output includes three views: the original, the rendered mesh, and the mesh overlaid on the original.

🐑🐑 SHeaP inference code is out ! 🐑🐑For all your real-time head pose and expression tracking desires! Check it out at: 🤗 HuggingFace spaces: huggingface.co/spaces/nlml/... 📟 Github: github.com/nlml/sheap

Feels to me like there is plenty more you could add. Some of Francois Chollet’s ideas are pretty interesting and on point.

📢 Our new paper - SHeaP - is out! 📢

TLDR: self-supervised head tracking and geometry (FLAME) prediction, learned via photometric loss with a 2D gaussian splatting renderer.

See more:
🌍 nlml.github.io/sheap/
🎥 youtu.be/vhXsZJWCBMA/

Interested in working (in Tokyo!) on reconstructing humans and their environments in 3D? We've just opened a position for a summer research intern!
jobs.lever.co/woven-by-toy...

Our latest work (shout out Jiapeng Tang) in the head avatars space!