Challenge 10 (Part 1): Phonemes & Performance (Lip Syncing & Facial Animation)
I found my reference audio on 11 Second Club. And here is the clip.
Then I typed audio into text so that I could lip-sync it. Here is the text:
‘Then one day I was driving my little boy to school and I saw this quote by Walt Whitman. It was painted on wall there it said be curious not judgmental. I like that.’
Next step I filmed my own footage reference and then bring it with the audio into Premiere Pro. I cut out the part I want and match with the audio. To be honest, it is a hard process because my lip didn’t match with the rhythm of the reference audio.
Then I bring the footage into After Effect to add a timecode. Also export a PNG sequence in order for maya reference. And here is the finally export footage reference:
Here is the ‘Jaw Bounce’ animation which only has jaw rotated.
Here is the ‘Viseme’ animation which contains lips movement. Also, I adjusted a few keys on jaw to match the lip syncing.
Challenge 10 (Part 2): Phonemes & Performance (Lip Syncing & Facial Animation)
I import my footage reference as image sequence into maya and began improving mouth enhancements on tongue and lips. Also upper hemisphere movements on brows and eyeballs.
Here is the animation outcome at this stage. In the next step, I’ll do body movement with performance.