Viseme Lips sync

[bouich jules]

Hi, i tried the Viseme lips sync, with Papagayo which is really outdated and hard to find a download link, and also with AUTOLIPSSYNC-o-Tizer which is the same tool as papagayo but a bit more updated..

However for long sentence, they both have a huge lips sync problem with the VISEME, so i’m definitely sure it’s a VISEME issue because both .DAT are not properly processed.

‌

Here is a video when i’m trying to lips sync in attachment,

https://gfycat.com/gleamingharmoniousdoe

‌

Thank you

‌

‌

[Alessandro Padovani]

I don’t seem to have any issue here. Sample animation included papagayo.mp4 (147K).

edit. Wanted to reupload the video with some subdivision but it seems I can’t delete and reupload my own files here. Sorry.

[bouich jules]

I got it , it’s the MHX RIG problem!

i also can’t move the eyes ( rotation ) when i change to MHX rig ( the location works)

It’s working fine without the MHX rig.

‌

Same with those viseme works fine but without MHX only!

[bouich jules]

Also without the MHX rig its better but its still way too fast ..

i made sure to be on 24fps on papagayo and on blender.

[Alessandro Padovani]

blender 2.92, diffeo 1.6.0.0273, mhx 45edea9

Bouich, so doesn’t my example work for you ? Because it works fine here as the included video papagayo.mp4 is showing. And I didn’t do anything fancy really just loaded and rendered it.

edit. Tested mhx and it works fine too.

edit. Thomas, on a side note you may want to version mhx too for reference in bug reports. Or distribute it together with diffeo so we get a single distribution file with both and we can just use the diffeo version for bug reports.

steps:

1. convert papagayo-test.mp3 to wav, otherwise autolipsync doesn’t read the mp3
2. load the wav into autolipsync and save as dat
3. load the dat on a G8F figure with visemes and render to mp4

‌

[Alessandro Padovani]

this is a test speech for papagayo to see if it works fine enough with diffeo

[bouich jules]

Thank you so much allesandro for your fast reply and your help.

Actually even in the video you send me if you look from 00:00 to 00:03 the lip sync is way too fast.

Anyway I will purchase and try with the ANILIP 2 hopefully I can get better result and hopefully I can export the facial animation to blender

‌

[Alessandro Padovani]

About it being “fast” (that’s really interleaving with mouth rest poses), that’s how autolipsync does it. It’s not daz or diffeo fault. Then I agree that automatic lipsync usually doesn’t get the best result to mimic what humans do but this is another story. And you can eventually edit the phonemes in papagayo or in blender to fix it.

If this is what you’re talking about then there is no bug report here and you can close this one.

[bouich jules]

Resolved