Projekte

General Information 

Bilateral project funded by the Austrian Science Fund (FWF) and the Czech Science Foundation (GACR)

Principal Investigator: Nicki Holighaus (Institut für Schallforschung, ARI, ÖAW)

Co-Principal Investigator: Pavel Rajmic (Signal Processing Laboratory, SPLab, Brno University of Technology)

Project Team (ARI) : Andres Marafioti, Rene Repp, Shristi Rajbamshi (from 12/2020)

Local Collaborators (ARI): Peter Balazs, Piotr MajdakGünther Koliander, Georg Tauböck, Thibaud Necciari, Zdenek Prusa

Duration: 01.06.2017 – 31.05.2021 (ARI) and 01.01.2017 – 31.12.2019 (SPLab)

Project Description

Locally degraded or lost information is frequently encountered in signal processing. Some prime examples include corrupted time segments in damaged old audio recordings, missing data in compressed audio or lost blocks of time-frequency coefficients, also referred to as packet loss during transmission, e.g. in VoIP. In these scenarios, information is lost or unreliable in large connected regions in time, frequency or time-frequency domains. Hence classical denoising or declicking methods that treat the whole signal or only isolated samples, respectively, cannot be applied. Automatic procedures to recover lost segments of signal data in either domain have seen increased attention in recent years and are often collectively referred to as inpainting.

However, the methods developed so far assume simplistic signal models that fail to capture the characteristic structures of speech and music data. Thus, the core objective of MERLIN is the development of novel and innovative inpainting methods through the combination of:

  1. modern adapted time-frequency representations,
  2. appropriate signal models obtained from prior information and the reliable signal segments,
  3. state-of-the-art signal processing and machine learning, and
  4. the consideration of perceptual indicators. 

The team at ARI is concerned in particular with

  • developing the mathematical theory, implementation and application of adapted time-frequency representations, in particular invertible representations inspired by auditory perception
  • phase processing and phaseless reconstruction for time-frequency representations
  • neural audio generation in the time-frequency domain and audio inpainting with neural networks

Further Information

Project webpage: http://merlin.utko.feec.vutbr.cz/

Publications: http://merlin.utko.feec.vutbr.cz/research-and-publications/

Keywords

adapted time-frequency representations, frame theory, perceptual signal processing, time-frequency processing, generative neural networks, audio inpainting, phaseless reconstruction, neural audio generation

Acoustic Phonetics = Ac. Phonetics
Mathematics and Signal Processing in Acoustics = Maths/SP in Ac.
Psychoacoustics and Experimental Audiology = EAP
Physical and Computational Acoustics = Phys/Comp Ac.
Title
Group
Researchers
Funding
Status
Pole-Zero-VokaltraktmodellPhys/Comp Ac.Kaseß, KreuzerCurrent
RailVib - Vibrationen von EisenbahntunnelsPhys/Comp Ac.Kreuzer, Waubke, Schmutzhard, HrycakOEAWCurrent
Wavelets and Frames zur Darstellung von akustischen Wellenfeldern in der Raum-Zeit-Frequenz EbeneMaths/SP in Ac., Phys/Comp Ac.KreuzerCurrent
ZK Dynamates: Dynamiken der auditiven Prädiktion in menschlichen und anderen PrimatenEAPBaumgartnerFWFCurrent
AABBA - Aural Assessment By means of Binaural AlgorithmsEAPBaumgartner, Laback, MajdakCurrent
Acoustic cues in production and perception of irony in normal-hearing and CI-listenersAc. PhoneticsLeykumCurrent
Acoustic Features for Speaker ModelsAc. PhoneticsCurrent
ANACRES - Analysis and Acoustics ResearchMaths/SP in Ac.Balazs, Abreu, Speckbacher, StoevaWTZCurrent
Automatic Speaker IdentificationAc. PhoneticsCurrent
Automatic Speaker VerificationAc. PhoneticsCurrent
Beam FormingPhys/Comp Ac.Mihocic, WaubkeCurrent
Born2Hear: Development and Adaptation of Auditory Spatial Processing Across the Human LifespanEAPBaumgartnerCurrent
Die Stimme der jungen Wienerin – eine experimental-phonetische Longitudinalstudie zur Stimmqualität von jungen WienerinnenAc. PhoneticsLozo, PucherKultur WienCurrent
ExpSuite: Software for Psychoacoustic TestsEAPMajdak, MihocicCurrent
FLAME: Frames and Linear Operators for Acoustical Modeling and Parameter Estimation.Maths/SP in Ac.Balazs, Abreu, Holighaus, Necciari, Speckbacher, Stoeva, TauböckFWFCurrent
Frames, Reconstruction, and ApplicationsMaths/SP in Ac.StoevaCurrent
Galerkin Approach Combined With the Fast Multipole MethodPhys/Comp Ac.Current
INSIGHT: Infinite Dimensional Signal Processing Techniques for Acoustic ApplicationsMaths/SP in Ac.Balazs, Tauböck, Romero, KolianderWWTFCurrent
Irregular Frames of TranslatesMaths/SP in Ac.BalazsCurrent
ITD PsyPhyEAPLaback, MajdakNIHCurrent
LabEquip: Equipment and Facilities in the LabEAPMajdak, MihocicCurrent
LARSPhys/Comp Ac.Kaseß, WaubkeCurrent
Lateral Variants of Bosnian Migrants Living in ViennaAc. PhoneticsSchmidCurrent
Measurement of Head-Related Transfer Functions (HRTFs)EAPMajdak, MihocicCurrent
MERLIN - Modern methods for the restoration of lost information in digital signalsMaths/SP in Ac.HolighausFWFCurrent
MissiSIPI: Towards Improving Selective Hearing in Cochlear Implant ListenersEAPLaback, LindenbeckDOCCurrent
Optimal Gaussian Mixture Model (GMM) Initialization for Speaker ModelingAc. PhoneticsCurrent
Orthobem: Simulation of Vibrations in TunnelsPhys/Comp Ac.WaubkeCurrent
PAABPhys/Comp Ac.Kaseß, WaubkeCurrent
Practical Time Frequency AnalysisMaths/SP in Ac.Holighaus, PrusaCurrent
QWeightEAPLaback, FerberCurrent
RAARA - Residential Area Augmented Reality AcousticsPhys/Comp Ac.Kaseß, WaubkeFFGCurrent
SOFA: Spatially Oriented Format for AcousticsEAPMajdak, MihocicCurrent
softpinna: Non-Rigid Registration for the Calculation of HRTFsEAPMajdak, PollackFFGCurrent
Soziolekte in Wien - die mittelbairischen VarietätenAc. PhoneticsMoosmüllerKultur WienCurrent
Stochastic Transformation Methods (Acoustics and Vibration)Phys/Comp Ac.WaubkeCurrent
VarDiÖ: Variation and Change of dialect varieties in Austria (in apparent and real time)Ac. PhoneticsMoosmüller, Rausch-SupolaFWFCurrent
Vibrations in Random LayersPhys/Comp Ac.WaubkeCurrent
Vowel and consonant quantity in Southern German varietiesAc. PhoneticsMoosmüller, KlinglerCurrent
WiABahn - Akustische Wirkung von gleisnahen Abschirmkanten und BahnsteigdächernPhys/Comp Ac.Kaseß, Kreuzer, WaubkeCurrent

40 results were found