Eye Mesh Shadow & PF Blink Updates
PlugFrame's have an eye openness property for left/right eyes. This openness value sets the eyelid openness from 0.0-1.0, where 0.5 is resting, 0.0 is closed and 1.0 is open wide.
With great enough tracking precision, eye openness can also convey blinking on the same property since an eyelid can only be in a fixed number of configurations.
But we don't have that degree of precision yet, so a quick solution would be to add a blink trigger to the PlugFrame that could initiate a System Blink.
A System Blink is what occurs when a puppet is in its resting state. This blink is controlled by a curve and can be guaranteed to look correct.
The existing blink system works as a general override to the eye openness property, clamping it to zero during the peak of a blink cycle.
Because of this, simply triggering a System Blink during plug playback can produce a better looking blink during speech.
Because of the difficulties in fine tracking the eyelids, we can use coarse data like dlib to know generally the points in a clip where the lids are completely closed, and translate that frame into a blink trigger.
Eyes are kinda gross and beautiful at the same time