Speech Processing and Language Understanding

Advancements in Artificial Intelligence (AI) methods have enabled the development of Large Language Models (LLMs) capable of generating information from user instructions and supporting various tasks in education, research, healthcare, and others. AI has also impacted the field of medical imaging with several deep learning models capable of achieving expert-level performance across different tasks, e.g., detection, segmentation, and assisted clinical diagnosis. In addition, open-source Automatic Speech Recognition (ASR) systems can be incorporated as modules in AI-based systems. This proposed funded project aims to combine LLMs, medical imaging, and speech recognition using AI methods to generate high-quality radiology reports from chest X-ray images.

→ More information

There are an increasing number of people across Europe with debilitating speech pathologies (e.g., due to stroke, Parkinson's, etc). These groups face communication problems that can lead to social exclusion. They are now being further marginalised by a new wave of speech technology that is increasingly woven into everyday life but which is not robust to atypical speech. TAPAS is a Horizon 2020 Marie Skłodowska-Curie Actions Innovative Training Network European Training Network (MSCA-ITN-ETN) project that aims to transform the well being of these people.

TAPAS adopts an inter-disciplinary and multi-sectorial approach. The consortium includes clinical practitioners, academic researchers and industrial partners, with expertise spanning speech engineering, linguistics and clinical science. All members have expertise in some element of pathological speech. This rich network will train a new generation of 15 researchers, equipping them with the skills and resources necessary for lasting success.

→ More information

Dysarthrien sind neurologisch bedingte, erworbene Störungen des Sprechens. Dabei sind vor allem die Koordination und Ausführung der Sprechbewegungen, aber auch die Mimik betroffen. Besonders häufig tritt eine Dysarthrie nach einem Schlaganfall, Schädel-Hirn-Trauma oder bei neurologischen Erkrankungen wie Parkinson auf.

Ähnlich wie in allen Sprechtherapien erfordert auch die Behandlung der Dysarthrie ein intensives Training. Anhaltende Effekte der Dysarthrie-Therapie stellen sich deshalb nur …

→ More information

Develop speech technology that can allow unobtrusive monitoring of many kinds of neurological diseases. The state of a patient can degrade slowly between medical check-ups. We want to track the state of a patient unobtrusively without the feeling of constant supervision. At the same time the privacy of the patient has to be respected. We will concentrate on PD and thus on acoustic cues of changes. The algorithms should run on a smartphone, track acoustic changes during regular phone conversations…

→ More information

Deep Learning applied to animal linguistics in particular the analysis of underwater audio recordings of marine animals (killer whales):

The project includes the automatic segmentation of killer whale signals in noise-heavy and large underwater bioacoustic archives as well as a subsequent call type identification/classification in order to derive linguistic elements/patterns. In combination with the recorded situational video footage those patterns should help to decode the killer whale language.

→ More information

Reduction of unwanted environmental noises is an important feature of today’s hearing aids, which is why noise reduction is nowadays included in almost every commercially available device. The majority of these algorithms, however, is restricted to the reduction of stationary noises. Due to the large number of different background noises in daily situations, it is hard to heuristically cover the complete solution space of noise reduction schemes. Deep learning-based algorithms pose a possible so…

→ More information

Generative AI has revolutionized the ability to simulate and generate information from learned distributions, with impactful applications in fields such as natural language processing and computer vision. This project will utilize generative models for two key medical applications: (1) simulation of patient speech stimuli: AI will simulate vocal tract movements of patients undergoing therapy for tongue cancer or cleft lip and palate conditions.

→ More information