FaceMesh Placement Checkpoint
A FaceMesh checkpoint that stopped heads drifting across thousands of images, and turned the fix into a consistency check for the whole system.
- Client
- Series Entertainment
- My role
- Pipeline engineering
The bug
In an avatar system making thousands of images, heads slowly drifted. Position and rotation just wouldn’t hold, and at that volume, by the time anyone spots it by eye, thousands of images are already wrong.
The fix
A checkpoint in the workflow that uses FaceMesh to lock a reference point between the eyes, then tracks rotation and placement on every image.
The bonus
To fix the drift I had to measure face shape and the spacing of features. Those measurements turned out to be useful on their own, and became a consistency check for the whole system. That is the kind of return you only get when you fix a problem in the pipeline instead of one image at a time.
