Philipp Klumpp

Philipp Klumpp, M. Sc.

Researcher

Pattern Recognition Lab
Speech Processing and Understanding

Room 10.158
Martensstraße 3
91058 Erlangen
Germany

Phone number: +4991318527137
Email: philipp.klumpp@fau.de

Since 10/2017:
Researcher at Pattern Recognition Lab, FAU
Since 10/2010:
Medical engineering student at FAU

2017

Development of a digital therapy tool as an exercise supplement for speech disorders and facial paralysis

(Third Party Funds Single)

Term: June 1, 2017 - December 31, 2019
Funding source: Bundesministerium für Wirtschaft und Energie (BMWE)

Abstract

Dysarthrien sind neurologisch bedingte, erworbene Störungen des Sprechens. Dabei sind vor allem die Koordination und Ausführung der Sprechbewegungen, aber auch die Mimik betroffen. Besonders häufig tritt eine Dysarthrie nach einem Schlaganfall, Schädel-Hirn-Trauma oder bei neurologischen Erkrankungen wie Parkinson auf.

Ähnlich wie in allen Sprechtherapien erfordert auch die Behandlung der Dysarthrie ein intensives Training. Anhaltende Effekte der Dysarthrie-Therapie stellen sich deshalb nur nach einem umfangreichen Behandlungsprogramm über mehrere Wochen hinweg ein. Bisher gibt es jedoch kaum Möglichkeiten zur Selbstkontrolle für Patienten noch therapeutische Anleitung in einem häuslichen Umfeld. Auch die Rückmeldung an Ärzte / Therapeuten über den Therapieerfolg ist eher lückenhaft.

Das Projekt DysarTrain setzt genau hier an und will ein interaktives, digitales Therapieangebot für das Sprechtraining schaffen, damit Patienten ihre Übungen im häuslichen Umfeld durchführen können. In enger Abstimmung mit Ärzten, Therapeuten und Patienten werden zuerst die passenden Therapieinhalte zur Behandlung von Dysarthrien ausgewählt und digitalisiert. In einem zweiten Schritt wird eine Therapieplattform mit den geeigneten Kommunikations-, Interaktions- und Supervisionsfunktionen aufgebaut. Für die Durchführung des Trainings werden anschließend Assistenzfunktionen und Feedbackmechanismen entwickelt. Das Programm soll automatisch rückmelden, ob eine Übung gut absolviert wurde und was ggf. noch verbessert werden kann. Eine automatisierte Auswertung der Therapiedaten erlaubt es Ärzten und Therapeuten, die Therapieform auf möglichst einfache Weise zu individualisieren und an den jeweiligen Therapiestand anzupassen. Dieses Angebot wird mit Ärzten, Therapeuten und Patienten in den Behandlungsprozess integriert und evaluiert.

→More information

2024

Conference Contributions

Perez Toro PA., Arias Vergara T., Klumpp P., Weise T., Schuster M., Nöth E., Orozco Arroyave JR., Maier A.:
Multilingual Speech and Language Analysis for the Assessment of Mild Cognitive Impairment: Outcomes from the Taukadial Challenge
25th Interspeech Conferece 2024 (Kos Island, September 1, 2024 - September 5, 2024)
In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2024
DOI: 10.21437/Interspeech.2024-2115
BibTeX: Download
Weise T., Klumpp P., Demir K., Perez Toro PA., Schuster M., Nöth E., Heismann B., Maier A., Yang SH.:
Speaker-and Text-Independent Estimation of Articulatory Movements and Phoneme Alignments from Speech
25th Interspeech Conferece 2024 (Kos Island, September 1, 2024 - September 5, 2024)
In: Interspeech 2024 2024
DOI: 10.21437/Interspeech.2024-1208
BibTeX: Download

Thesis

Klumpp P.:
Phonetic Transfer Learning from Healthy References for the Analysis of Pathological Speech (Dissertation, 2024)
DOI: 10.25593/open-fau-797
URL: https://open.fau.de/handle/openfau/31315
BibTeX: Download

2023

Conference Contributions

Perez Toro PA., Rodriguez Salas D., Arias Vergara T., Bayerl SP., Klumpp P., Riedhammer KT., Schuster M., Nöth E., Maier A., Orozco Arroyave JR.:
Transferring Quantified Emotion Knowledge for the Detection of Depression in Alzheimer’s Disease Using Forestnets
International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (Rhodes Island, June 4, 2023 - June 10, 2023)
In: ICASSP 2023 2023
DOI: 10.1109/ICASSP49357.2023.10095219
BibTeX: Download

2022

Authored Books

Perez Toro PA., Klumpp P., Vásquez-Correa JC., Schuster M., Nöth E., Orozco-Arroyave JR., Arias Vergara T.:
50 Shades of Gray: Effect of the Color Scale for the Assessment of Speech Disorders
Springer Science and Business Media Deutschland GmbH, 2022
ISBN: 9783031162695
DOI: 10.1007/978-3-031-16270-1_29
BibTeX: Download

Journal Articles

Perez Toro PA., Rodriguez Salas D., Arias Vergara T., Klumpp P., Schuster M., Nöth E., Orozco Arroyave JR., Maier A.:
Interpreting acoustic features for the assessment of Alzheimer's disease using ForestNet
In: Smart Health 26 (2022), Article No.: 100347
ISSN: 2352-6483
DOI: 10.1016/j.smhl.2022.100347
BibTeX: Download
Perez Toro PA., Arias Vergara T., Klumpp P., Vásquez-Correa JC., Schuster M., Nöth E., Orozco Arroyave JR.:
Depression assessment in people with Parkinson's disease: The combination of acoustic features and natural language processing
In: Speech Communication 145 (2022), p. 10-20
ISSN: 0167-6393
DOI: 10.1016/j.specom.2022.09.001
BibTeX: Download
Perez Toro PA., Arias Vergara T., Klumpp P., Vásquez-Correa JC., Schuster M., Nöth E., Orozco-Arroyave JR.:
Depression assessment in people with Parkinson's disease: The combination of acoustic features and natural language processing
In: Speech Communication 145 (2022), p. 10-20
ISSN: 0167-6393
DOI: 10.1016/j.specom.2022.09.001
BibTeX: Download
Perez Toro PA., Rodriguez Salas D., Arias Vergara T., Klumpp P., Schuster M., Nöth E., Orozco-Arroyave JR., Maier A.:
Interpreting acoustic features for the assessment of Alzheimer's disease using ForestNet
In: Smart Health 26 (2022), Article No.: 100347
ISSN: 2352-6483
DOI: 10.1016/j.smhl.2022.100347
BibTeX: Download

Conference Contributions

Hernandez A., Klumpp P., Das BK., Maier A., Yang SH.:
Autoblog 2021: The Importance of Language Models for Spontaneous Lecture Speech
25th International Conference on Text, Speech and Dialogue (Brno, Czech Republic, September 6, 2022 - September 9, 2022)
In: Petr Sojka, Aleš Horák, Ivan Kopeček, Karel Pala (ed.): Text, Speech, and Dialogue 25th International Conference, TSD 2022, Brno, Czech Republic, September 6–9, 2022, Proceedings, Springer Nature Switzerland AG: 2022
DOI: 10.1007/978-3-031-16270-1_24
URL: https://link.springer.com/chapter/10.1007/978-3-031-16270-1_24
BibTeX: Download
Kordowich G., Lorz T., Jaworski M., Klumpp P., Perez Toro PA., Gaube S., Kereit M., Böhme K., Nöth E., Jäger J.:
Erdschlusserkennung basierend auf Künstlichen Neuronalen Netzen
12. VDE ETG-/FNN-Tutorial Schutz- und Leittechnik (Berlin, June 21, 2022 - June 22, 2022)
BibTeX: Download
Pérez-Toro PA., Klumpp P., Vasquez-Correa JC., Schuster M., Nöth E., Orozco-Arroyave JR., Arias Vergara T.:
50 Shades of Gray: Effect of the Color Scale for the Assessment of Speech Disorders
25th International Conference on Text, Speech, and Dialogue, TSD 2022 (Brno, CZE, September 6, 2022 - September 9, 2022)
In: Petr Sojka, Aleš Horák, Ivan Kopeček, Karel Pala (ed.): Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 2022
DOI: 10.1007/978-3-031-16270-1_29
BibTeX: Download
Perez Toro PA., Klumpp P., Hernandez A., Arias Vergara T., Lillo P., Slachevsky A., García AM., Schuster M., Maier A., Nöth E., Orozco Arroyave JR.:
Alzheimer's Detection from English to Spanish Using Acoustic and Linguistic Embeddings
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022 (Incheon, September 18, 2022 - September 22, 2022)
In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
DOI: 10.21437/Interspeech.2022-10883
BibTeX: Download
Schäfer P., Perez Toro PA., Klumpp P., Orozco Arroyave JR., Nöth E., Maier A., Abad A., Schuster M., Arias Vergara T.:
CoachLea: an Android Application to Evaluate the Speech Production and Perception of Children with Hearing Loss
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022 (Incheon, KOR, September 18, 2022 - September 22, 2022)
In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
BibTeX: Download
Schäfer P., Perez Toro PA., Klumpp P., Orozco-Arroyave JR., Nöth E., Maier A., Abad A., Schuster M., Arias Vergara T.:
CoachLea: an Android Application to Evaluate the Speech Production and Perception of Children with Hearing Loss
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
URL: https://www.scopus.com/record/display.uri?eid=2-s2.0-85140086069∨igin=inward
BibTeX: Download
Klumpp P., Arias-Vergara T., Perez-Toro PA., Nöth E., Orozco-Arroyave JR.:
Common Phone: A Multilingual Dataset for Robust Acoustic Modelling
13th International Conference on Language Resources and Evaluation (LREC) (Marseille, FRANCE)
In: LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, PARIS: 2022
DOI: 10.5281/zenodo.5846137
BibTeX: Download
tom Dieck T., Perez Toro PA., Arias Vergara T., Nöth E., Klumpp P.:
Wav2vec behind the Scenes: How end2end Models learn Phonetics
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
DOI: 10.21437/Interspeech.2022-10865
BibTeX: Download
tom Dieck T., Perez Toro PA., Arias Vergara T., Nöth E., Klumpp P.:
Wav2vec behind the Scenes: How end2end Models learn Phonetics
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022 (Incheon, September 18, 2022 - September 22, 2022)
In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
DOI: 10.21437/Interspeech.2022-10865
BibTeX: Download

2021

Journal Articles

Martindale C., Christlein V., Klumpp P., Eskofier B.:
Wearables-based multi-task gait and activity segmentation using recurrent neural networks
In: Neurocomputing 432 (2021), p. 250-261
ISSN: 0925-2312
DOI: 10.1016/j.neucom.2020.08.079
BibTeX: Download
Klumpp P., Arias Vergara T., Vásquez-Correa JC., Perez Toro PA., Orozco-Arroyave JR., Batliner A., Nöth E.:
The Phonetic Footprint of Parkinson's Disease
In: Computer Speech and Language 72 (2021)
ISSN: 0885-2308
DOI: 10.1016/j.csl.2021.101321
URL: https://www.sciencedirect.com/science/article/abs/pii/S0885230821001169
BibTeX: Download

Conference Contributions

Perez Toro PA., Vasquez Correa J., Arias Vergara T., Klumpp P., Sierra-Castrillón M., Roldán-López ME., Aguillón D., Hincapié-Henao L., Tóbon-Quintero CA., Bocklet T., Schuster M., Orozco-Arroyave JR., Nöth E.:
Acoustic and Linguistic Analyses to Assess Early-Onset and Genetic Alzheimer's Disease
ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
DOI: 10.1109/ICASSP39728.2021.9414009
URL: https://ieeexplore.ieee.org/abstract/document/9414009
BibTeX: Download
Perez Toro PA., Vásquez-Correa JC., Arias Vergara T., Klumpp P., Schuster M., Nöth E., Orozco-Arroyave JR.:
Emotional State Modeling for the Assessment of Depression in Parkinson’s Disease
24th International Conference on Text, Speech, and Dialogue, TSD 2021 (Olomouc, CZE, September 6, 2021 - September 9, 2021)
In: Kamil Ekštein, František Pártl, Miloslav Konopík (ed.): Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 2021
DOI: 10.1007/978-3-030-83527-9_39
BibTeX: Download
Vasquez Correa J., Arias Vergara T., Klumpp P., Perez Toro PA., Orozco-Arroyave JR., Nöth E.:
End-2-End Modeling of Speech and Gait from Patients with Parkinson’s Disease: Comparison Between High Quality Vs. Smartphone Data
ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
DOI: 10.1109/ICASSP39728.2021.9414729
URL: https://ieeexplore.ieee.org/abstract/document/9414729
BibTeX: Download
Perez Toro PA., Bayerl S., Arias Vergara T., Vasquez Correa J., Klumpp P., Schuster M., Nöth E., Orozco-Arroyave JR., Riedhammer K.:
Influence of the Interviewer on the Automatic Assessment of Alzheimer’s Disease in the Context of the ADReSSo Challenge
22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021 (, August 30, 2021 - September 3, 2021)
In: Proc. Interspeech 2021 2021
DOI: 10.21437/Interspeech.2021-1589
BibTeX: Download
Klumpp P., Bocklet T., Arias Vergara T., Vasquez Correa J., Perez Toro PA., Bayerl S., Orozco-Arroyave JR., Nöth E.:
The Phonetic Footprint of Covid-19
Interspeech 2021 (, August 30, 2021 - September 3, 2021)
In: Proc. Interspeech 2021 2021
DOI: 10.21437/Interspeech.2021-1488
BibTeX: Download

2020

Journal Articles

Orozco-Arroyave JR., Vasquez Correa J., Klumpp P., Perez Toro PA., Escobar-Grisales D., Roth N., Ríos-Urrego CD., Strauß M., Carvajal-Castaño HA., Bayerl S., Castrillón-Osorio LR., Arias-Vergara T., Küderle A., López-Pabón FO., Parra-Gallego LF., Eskofier B., Gómez-Gómez LF., Schuster M., Nöth E.:
Apkinson: the smartphone application for telemonitoring Parkinson's patients through speech, gait and hands movement
In: Neurodegenerative Disease Management (2020)
ISSN: 1758-2024
DOI: 10.2217/nmt-2019-0037
BibTeX: Download
Arias-Vergara T., Klumpp P., Vasquez-Correa JC., Nöth E., Orozco-Arroyave JR., Schuster M.:
Multi-channel spectrograms for speech processing applications using deep learning methods
In: Pattern Analysis and Applications (2020)
ISSN: 1433-7541
DOI: 10.1007/s10044-020-00921-5
BibTeX: Download

Conference Contributions

Klumpp P., Fritsch JD., Nöth E.:
ANN-based Alzheimer's disease classification from bag of words
13th ITG Conference on Speech Communication (Oldenburg, October 10, 2018 - October 12, 2018)
In: Speech Communication - 13th ITG-Fachtagung Sprachkommunikation 2020
BibTeX: Download
Klumpp P., Arias Vergara T., Vásquez-Correa JC., Pérez-Toro PA., Hönig FT., Nöth E., Orozco-Arroyave JR.:
Surgical mask detection with deep recurrent phonetic models
Interspeech 2020
In: Interspeech 2020 2020
BibTeX: Download
Klumpp P., Arias Vergara T., Vasquez Correa J., Perez Toro PA., Hönig FT., Nöth E., Orozco-Arroyave JR.:
Surgical mask detection with deep recurrent phonetic models
21st Annual Conference of the International Speech Communication Association, INTERSPEECH 2020
DOI: 10.21437/Interspeech.2020-1723
BibTeX: Download

2019

Conference Contributions

Vásquez-Correa JC., Klumpp P., Arias-Vergara T., Strauß M., Küderle A., Roth N., Bayerl S., García-Ospina N., Perez Toro PA., Parra-Gallego LF., Rios-Urrego CD., Escobar-Grisales D., Orozco-Arroyave JR., Eskofier B., Nöth E.:
Apkinson: A mobile solution for multimodal assessment of patients with Parkinson's disease
20th Annual Conference of the International Speech Communication Association: Crossroads of Speech and Language, INTERSPEECH 2019 (Graz, September 15, 2019 - September 19, 2019)
In: Gernot Kubin, Thomas Hain, Bjorn Schuller, Dina El Zarka, Petra Hodl (ed.): Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2019
DOI: 10.21437/Interspeech.2019-8003
URL: https://www.isca-speech.org/archive/Interspeech_2019/abstracts/8003.html
BibTeX: Download
Klumpp P., Vasquez Correa J., Haderlein T., Nöth E.:
Feature space visualization with spatial similarity maps for pathological speech data
20th Annual Conference of the International Speech Communication Association: Crossroads of Speech and Language, INTERSPEECH 2019 (Graz, September 15, 2019 - September 19, 2019)
In: Gernot Kubin, Thomas Hain, Bjorn Schuller, Dina El Zarka, Petra Hodl (ed.): Proc. Interspeech 2019 2019
DOI: 10.21437/Interspeech.2019-2080
BibTeX: Download
Vasquez Correa J., Klumpp P., Orozco Arroyave JR., Nöth E.:
Phonet: A tool based on gated recurrent neural networks to extract phonological posteriors from speech
20th Annual Conference of the International Speech Communication Association: Crossroads of Speech and Language, INTERSPEECH 2019 (Graz, September 15, 2019 - September 19, 2019)
In: Gernot Kubin, Thomas Hain, Bjorn Schuller, Dina El Zarka, Petra Hodl (ed.): Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2019
DOI: 10.21437/Interspeech.2019-1405
BibTeX: Download

2018

Conference Contributions

Klumpp P., Fritsch JD., Nöth E.:
ANN-based Alzheimer’s disease classification from bag of words
Speech Communication - 13. ITG-Fachtagung Sprachkommunikation
In: Speech Communication - 13. ITG-Fachtagung Sprachkommunikation 2018
URL: https://www.idiap.ch/~jfritsch/pdf/2018ITG.pdf
BibTeX: Download
Arias Vergara T., Vasquez Correa J., Orozco Arroyave JR., Klumpp P., Nöth E.:
Unobtrusive Monitoring of Speech Impairments of Parkinson's Disease Patients Through Mobile Devices
2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018
DOI: 10.1109/ICASSP.2018.8462332
BibTeX: Download
Arias Vergara T., Vasquez Correa J., Orozco-Arroyave JR., Klumpp P., Nöth E.:
Unobtrusive Monitoring of Speech Impairments of Parkinson'S Disease Patients Through Mobile Devices
43rd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
DOI: 10.1109/ICASSP.2018.8462332
URL: https://ieeexplore.ieee.org/abstract/document/8462332
BibTeX: Download

2017

Conference Contributions

Klumpp P., Janu T., Arias Vergara T., Vasquez Correa J., Orozco-Arroyave JR., Nöth E.:
Apkinson — A Mobile Monitoring Solution for Parkinson's Disease
Interspeech 2017
In: Interspeech 2017 2017
URL: https://www.researchgate.net/profile/Juan_Vasquez12/publication/319185470_Apkinson_-_A_Mobile_Monitoring_Solution_for_Parkinson's_Disease/links/59b9fecfa6fdcc68723177dc/Apkinson-A-Mobile-Monitoring-Solution-for-Parkinsons-Disease.pdf
BibTeX: Download
Arias Vergara T., Klumpp P., Vasquez Correa J., Orozco Arroyave JR., Nöth E.:
Parkinson’s disease progression assessment from speech using a mobile device-based application
20th International Conference on Text, Speech and Dialogue, TSD 2017
In: TSD 2017: Text, Speech, and Dialogue 2017
DOI: 10.1007/978-3-319-64206-2_42
BibTeX: Download

No matching records found.

Philipp Klumpp, M. Sc.

Academic CV

Projects

2017

Development of a digital therapy tool as an exercise supplement for speech disorders and facial paralysis

Publications

2024

Conference Contributions

Thesis

2023

Conference Contributions

2022

Authored Books

Journal Articles

Conference Contributions

2021

Journal Articles

Conference Contributions

2020

Journal Articles

Conference Contributions

2019

Conference Contributions

2018

Conference Contributions

2017

Conference Contributions

Lectures