©2003 Kåre Sjölander and Jonas Beskow
Introduction Download Documentation Links Forum
WaveSurfer user forum

FAQ  FAQ
Search  Search
Memberlist  Memberlist
Register  Register
Profile  Profile
Login  Login

animation with automatic lipsync - possible?

 
Post new topic   Reply to topic    www.speech.kth.se/wavesurfer Forum Index -> WaveSurfer
View previous topic :: View next topic  
Author Message
gunnar
Guest





PostPosted: Wed Mar 24, 2004 11:55 pm    Post subject: animation with automatic lipsync - possible? Reply with quote

Is it possible to automatically get the soundvolume e.g every tenth of a second
as output in a lab-file?

Or to put it another way - is it possible to automatically insert labels e.g. every tenth of a second?

I want to use WaveSurfer for doing lipsync depending only on the volume of the sound not on the phonemes - a very simple form of lipsync - but time saving! icon_lol.gif

Perhaps it is possible to use wavesurfer to automatically output the phonems? the time correlated to a phoneme? the length of it? and the volume of it?
Back to top
gunnar
Guest





PostPosted: Thu Mar 25, 2004 2:12 pm    Post subject: animation with automatic lipsync - possible? Reply with quote

Here you can see examples of lipsync in 3D done with WaveSurfer or Pamela with some work.
http://www.muranon.com/axel/stage/lipbox/index.shtml
http://medieskolan.avc.edu.stockholm.se/axel/index.htm

But I want to do it more automatic getting a list of numbers(.lab-file) with the soundvolume from WaveSurfer for each frame in the animation, So I wonder if you can you do automatic labeling with some script in WaveSurfer? Or is it some other way?
Back to top
gunnar
Guest





PostPosted: Thu Mar 25, 2004 11:44 pm    Post subject: Re: animation with automatic lipsync - possible? Reply with quote

Hi!
NOT AN ANSWER!!! Why I do not understand. Give me a tip. icon_rolleyes.gif
Perhaps I have to use a speech recognition program to give WaveSurfer some nice input.

In Japanese there is Julius - http://julius.sourceforge.jp/en/julius.html
Is there some speech recognition program for Swedish? English? to use together with WaveSurfer?

I hope you all are playing with AXEL -http://www.mindavenue.com doing some nice lipsync in 3D!

A tip! icon_idea.gif The swedish filmmaker Ingemar Bergman began his carreer in a shoe box showing Mam and Dad his talents to master his actors. My intention is to make the computer to a shoe box for every schoolkid - so we can have not one Bergman - but a whole bunch of them around the globe on the 3G-mobiles in the 21st century.
Back to top
kare



Joined: 16 Aug 2002
Posts: 371
Location: KTH, Centre for Speech Technology

PostPosted: Fri Mar 26, 2004 11:48 am    Post subject: Reply with quote

Sorry for the delay in answering, had the flu...

In my research I work on speech segmentation, this means that I probably have things interesting to you, for example phone recognition and speech segmentation for Swedish (and American English) as plug-ins for WaveSurfer. However, these are not currently available for download. Please feel free to contact me by mail kare@speech.kth.se or phone +46 8 790 78 94.

Kåre
Back to top
View users profile Send private message Visit posters website
Display posts from previous:   
Post new topic   Reply to topic    www.speech.kth.se/wavesurfer Forum Index -> WaveSurfer All times are GMT + 1 Hour
Page 1 of 1

 
Jump to:  
You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB 2.0.1 © 2001, 2002 phpBB Group