Pipeline: 2. Facial Tracking
This post is a work in progress…
Use dlib to analyze a frame sequence
Temporally smooth points
Normalize points over time
Identify key elements like mouth width/openness
Identify phonemes
Estimate head pose over time using SolvePnP