IMAGE-FACE: Image Based Rendering of Faces


Problem statement – market
  • The market requires face animation solutions that can be based on video sequences of real persons, in order to synthesize interactive animation of faces as new video sequences.
Scientific challenges & contributions
  • Image based rendering of faces
  • Natural expression and capture of motions
  • Only head turning with the most dominant image changes is interpolated from a set of initially captured views
  • Other global head motions are represented with a geometry model
Framework for project
  • Basic R&D Project co-finaneced by Government & EU Union
Solution
  • Some results incorporated in novel coding & transmission solutions

DEAF-AVAT: Interactive Avatars for Impaired Hearing


Problem statement – market
  • Accesibility issues are very relevant in the future e-Inclusion Society. By law, all official services from Government require automatic translation to sign language. There is a market niche for Internet interactive services for deaf or hearing impaired people. Reading text is not easy for these persons, and interactive avatars can help.
Scientific challenges & contributions
  • Real time sign-language avatars that can interact remotely
  • Adaptation to different varieties of sign languages
  • TV interactive services integration
Framework for project
  • Industdial R&D project partially co-financed by Government
Solution
  • SMEs especialized in e-Inclusion now support their processes with the new product. They subtitle in Basque and Spanish languages

FANIM: Augmented Reality Real-time TV Characters


Problem statement – market
  • Real-world TV Broadcast need of real-time interactive characters that interact both with the audience and with the human presenters.
Scientific challenges & contributions
  • Real life augmented reality in TV professional sets
  • Real-time Animation of virtual character lipsynch using actor voice
  • Motion animation sequences activated in real time
  • Adaptation to multiple languages
Framework for project
  • Industdial R&D project partially co-financed by Government
Solution
  • SMEs in broadcasting/audiovisual sectors now have a new product