Philipp Klumpp
Philipp Klumpp, M. Sc.

Pattern Recognition Lab
Speech Processing and Understanding
Martensstraße 3
91058 Erlangen
Germany
- Phone number: +4991318527137
- Email: philipp.klumpp@fau.de
Academic CV
- Since 10/2017:
Researcher at Pattern Recognition Lab, FAU - Since 10/2010:
Medical engineering student at FAU
Projects
2017
-
Development of a digital therapy tool as an exercise supplement for speech disorders and facial paralysis
(Third Party Funds Single)
Term: June 1, 2017 - December 31, 2019
Funding source: Bundesministerium für Wirtschaft und Technologie (BMWi)Dysarthrien sind neurologisch bedingte, erworbene Störungen des Sprechens. Dabei sind vor allem die Koordination und Ausführung der Sprechbewegungen, aber auch die Mimik betroffen. Besonders häufig tritt eine Dysarthrie nach einem Schlaganfall, Schädel-Hirn-Trauma oder bei neurologischen Erkrankungen wie Parkinson auf.
Ähnlich wie in allen Sprechtherapien erfordert auch die Behandlung der Dysarthrie ein intensives Training. Anhaltende Effekte der Dysarthrie-Therapie stellen sich deshalb nur nach einem umfangreichen Behandlungsprogramm über mehrere Wochen hinweg ein. Bisher gibt es jedoch kaum Möglichkeiten zur Selbstkontrolle für Patienten noch therapeutische Anleitung in einem häuslichen Umfeld. Auch die Rückmeldung an Ärzte / Therapeuten über den Therapieerfolg ist eher lückenhaft.
Das Projekt DysarTrain setzt genau hier an und will ein interaktives, digitales Therapieangebot für das Sprechtraining schaffen, damit Patienten ihre Übungen im häuslichen Umfeld durchführen können. In enger Abstimmung mit Ärzten, Therapeuten und Patienten werden zuerst die passenden Therapieinhalte zur Behandlung von Dysarthrien ausgewählt und digitalisiert. In einem zweiten Schritt wird eine Therapieplattform mit den geeigneten Kommunikations-, Interaktions- und Supervisionsfunktionen aufgebaut. Für die Durchführung des Trainings werden anschließend Assistenzfunktionen und Feedbackmechanismen entwickelt. Das Programm soll automatisch rückmelden, ob eine Übung gut absolviert wurde und was ggf. noch verbessert werden kann. Eine automatisierte Auswertung der Therapiedaten erlaubt es Ärzten und Therapeuten, die Therapieform auf möglichst einfache Weise zu individualisieren und an den jeweiligen Therapiestand anzupassen. Dieses Angebot wird mit Ärzten, Therapeuten und Patienten in den Behandlungsprozess integriert und evaluiert.
Publications
2024
Conference Contributions
- Weise T., Klumpp P., Demir K., Perez Toro PA., Schuster M., Nöth E., Heismann B., Maier A., Yang SH.:
Speaker-and Text-Independent Estimation of Articulatory Movements and Phoneme Alignments from Speech
25th Interspeech Conferece 2024 (Kos Island, September 1, 2024 - September 5, 2024)
In: Interspeech 2024 2024
DOI: 10.21437/Interspeech.2024-1208
BibTeX: Download
Thesis
- Klumpp P.:
Phonetic Transfer Learning from Healthy References for the Analysis of Pathological Speech (Dissertation, 2024)
DOI: 10.25593/open-fau-797
URL: https://open.fau.de/handle/openfau/31315
BibTeX: Download
2023
Conference Contributions
- Perez Toro PA., Rodriguez Salas D., Arias Vergara T., Bayerl SP., Klumpp P., Riedhammer KT., Schuster M., Nöth E., Maier A., Orozco Arroyave JR.:
Transferring Quantified Emotion Knowledge for the Detection of Depression in Alzheimer’s Disease Using Forestnets
International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (Rhodes Island, June 4, 2023 - June 10, 2023)
In: ICASSP 2023 2023
DOI: 10.1109/ICASSP49357.2023.10095219
BibTeX: Download
2022
Authored Books
- Perez Toro PA., Klumpp P., Vásquez-Correa JC., Schuster M., Nöth E., Orozco-Arroyave JR., Arias Vergara T.:
50 Shades of Gray: Effect of the Color Scale for the Assessment of Speech Disorders
Springer Science and Business Media Deutschland GmbH, 2022
ISBN: 9783031162695
DOI: 10.1007/978-3-031-16270-1_29
BibTeX: Download
Journal Articles
- Perez Toro PA., Rodriguez Salas D., Arias Vergara T., Klumpp P., Schuster M., Nöth E., Orozco Arroyave JR., Maier A.:
Interpreting acoustic features for the assessment of Alzheimer's disease using ForestNet
In: Smart Health 26 (2022), Article No.: 100347
ISSN: 2352-6483
DOI: 10.1016/j.smhl.2022.100347
BibTeX: Download - Perez Toro PA., Arias Vergara T., Klumpp P., Vásquez-Correa JC., Schuster M., Nöth E., Orozco Arroyave JR.:
Depression assessment in people with Parkinson's disease: The combination of acoustic features and natural language processing
In: Speech Communication 145 (2022), p. 10-20
ISSN: 0167-6393
DOI: 10.1016/j.specom.2022.09.001
BibTeX: Download - Perez Toro PA., Arias Vergara T., Klumpp P., Vásquez-Correa JC., Schuster M., Nöth E., Orozco-Arroyave JR.:
Depression assessment in people with Parkinson's disease: The combination of acoustic features and natural language processing
In: Speech Communication 145 (2022), p. 10-20
ISSN: 0167-6393
DOI: 10.1016/j.specom.2022.09.001
BibTeX: Download - Perez Toro PA., Rodriguez Salas D., Arias Vergara T., Klumpp P., Schuster M., Nöth E., Orozco-Arroyave JR., Maier A.:
Interpreting acoustic features for the assessment of Alzheimer's disease using ForestNet
In: Smart Health 26 (2022), Article No.: 100347
ISSN: 2352-6483
DOI: 10.1016/j.smhl.2022.100347
BibTeX: Download
Conference Contributions
- Hernandez A., Klumpp P., Das BK., Maier A., Yang SH.:
Autoblog 2021: The Importance of Language Models for Spontaneous Lecture Speech
25th International Conference on Text, Speech and Dialogue (Brno, Czech Republic, September 6, 2022 - September 9, 2022)
In: Petr Sojka, Aleš Horák, Ivan Kopeček, Karel Pala (ed.): Text, Speech, and Dialogue 25th International Conference, TSD 2022, Brno, Czech Republic, September 6–9, 2022, Proceedings, Springer Nature Switzerland AG: 2022
DOI: 10.1007/978-3-031-16270-1_24
URL: https://link.springer.com/chapter/10.1007/978-3-031-16270-1_24
BibTeX: Download - Kordowich G., Lorz T., Jaworski M., Klumpp P., Perez Toro PA., Gaube S., Kereit M., Böhme K., Nöth E., Jäger J.:
Erdschlusserkennung basierend auf Künstlichen Neuronalen Netzen
12. VDE ETG-/FNN-Tutorial Schutz- und Leittechnik (Berlin, June 21, 2022 - June 22, 2022)
BibTeX: Download - Pérez-Toro PA., Klumpp P., Vasquez-Correa JC., Schuster M., Nöth E., Orozco-Arroyave JR., Arias Vergara T.:
50 Shades of Gray: Effect of the Color Scale for the Assessment of Speech Disorders
25th International Conference on Text, Speech, and Dialogue, TSD 2022 (Brno, CZE, September 6, 2022 - September 9, 2022)
In: Petr Sojka, Aleš Horák, Ivan Kopeček, Karel Pala (ed.): Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 2022
DOI: 10.1007/978-3-031-16270-1_29
BibTeX: Download - Perez Toro PA., Klumpp P., Hernandez A., Arias Vergara T., Lillo P., Slachevsky A., García AM., Schuster M., Maier A., Nöth E., Orozco Arroyave JR.:
Alzheimer's Detection from English to Spanish Using Acoustic and Linguistic Embeddings
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022 (Incheon, September 18, 2022 - September 22, 2022)
In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
DOI: 10.21437/Interspeech.2022-10883
BibTeX: Download - Schäfer P., Perez Toro PA., Klumpp P., Orozco Arroyave JR., Nöth E., Maier A., Abad A., Schuster M., Arias Vergara T.:
CoachLea: an Android Application to Evaluate the Speech Production and Perception of Children with Hearing Loss
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022 (Incheon, KOR, September 18, 2022 - September 22, 2022)
In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
BibTeX: Download - Schäfer P., Pérez Toro PA., Klumpp P., Orozco-Arroyave JR., Nöth E., Maier A., Abad A., Schuster M., Arias Vergara T.:
CoachLea: an Android Application to Evaluate the Speech Production and Perception of Children with Hearing Loss
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
URL: https://www.scopus.com/record/display.uri?eid=2-s2.0-85140086069∨igin=inward
BibTeX: Download - Klumpp P., Arias-Vergara T., Perez-Toro PA., Nöth E., Orozco-Arroyave JR.:
Common Phone: A Multilingual Dataset for Robust Acoustic Modelling
13th International Conference on Language Resources and Evaluation (LREC) (Marseille, FRANCE)
In: LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, PARIS: 2022
DOI: 10.5281/zenodo.5846137
BibTeX: Download - tom Dieck T., Perez Toro PA., Arias Vergara T., Nöth E., Klumpp P.:
Wav2vec behind the Scenes: How end2end Models learn Phonetics
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022 (Incheon, September 18, 2022 - September 22, 2022)
In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
DOI: 10.21437/Interspeech.2022-10865
BibTeX: Download - tom Dieck T., Perez Toro PA., Arias Vergara T., Nöth E., Klumpp P.:
Wav2vec behind the Scenes: How end2end Models learn Phonetics
23rd Annual Conference of the International Speech Communication Association, INTERSPEECH 2022
DOI: 10.21437/Interspeech.2022-10865
BibTeX: Download
2021
Journal Articles
- Martindale C., Christlein V., Klumpp P., Eskofier B.:
Wearables-based multi-task gait and activity segmentation using recurrent neural networks
In: Neurocomputing 432 (2021), p. 250-261
ISSN: 0925-2312
DOI: 10.1016/j.neucom.2020.08.079
BibTeX: Download - Klumpp P., Arias Vergara T., Vásquez-Correa JC., Perez Toro PA., Orozco-Arroyave JR., Batliner A., Nöth E.:
The Phonetic Footprint of Parkinson's Disease
In: Computer Speech and Language 72 (2021)
ISSN: 0885-2308
DOI: 10.1016/j.csl.2021.101321
URL: https://www.sciencedirect.com/science/article/abs/pii/S0885230821001169
BibTeX: Download
Conference Contributions
- Perez Toro PA., Vasquez Correa J., Arias Vergara T., Klumpp P., Sierra-Castrillón M., Roldán-López ME., Aguillón D., Hincapié-Henao L., Tóbon-Quintero CA., Bocklet T., Schuster M., Orozco-Arroyave JR., Nöth E.:
Acoustic and Linguistic Analyses to Assess Early-Onset and Genetic Alzheimer's Disease
ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
DOI: 10.1109/ICASSP39728.2021.9414009
URL: https://ieeexplore.ieee.org/abstract/document/9414009
BibTeX: Download - Perez Toro PA., Vásquez-Correa JC., Arias Vergara T., Klumpp P., Schuster M., Nöth E., Orozco-Arroyave JR.:
Emotional State Modeling for the Assessment of Depression in Parkinson’s Disease
24th International Conference on Text, Speech, and Dialogue, TSD 2021 (Olomouc, CZE, September 6, 2021 - September 9, 2021)
In: Kamil Ekštein, František Pártl, Miloslav Konopík (ed.): Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 2021
DOI: 10.1007/978-3-030-83527-9_39
BibTeX: Download - Vasquez Correa J., Arias Vergara T., Klumpp P., Perez Toro PA., Orozco-Arroyave JR., Nöth E.:
End-2-End Modeling of Speech and Gait from Patients with Parkinson’s Disease: Comparison Between High Quality Vs. Smartphone Data
ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
DOI: 10.1109/ICASSP39728.2021.9414729
URL: https://ieeexplore.ieee.org/abstract/document/9414729
BibTeX: Download - Perez Toro PA., Bayerl S., Arias Vergara T., Vasquez Correa J., Klumpp P., Schuster M., Nöth E., Orozco-Arroyave JR., Riedhammer K.:
Influence of the Interviewer on the Automatic Assessment of Alzheimer’s Disease in the Context of the ADReSSo Challenge
22nd Annual Conference of the International Speech Communication Association, INTERSPEECH 2021 (, August 30, 2021 - September 3, 2021)
In: Proc. Interspeech 2021 2021
DOI: 10.21437/Interspeech.2021-1589
BibTeX: Download - Klumpp P., Bocklet T., Arias Vergara T., Vasquez Correa J., Perez Toro PA., Bayerl S., Orozco-Arroyave JR., Nöth E.:
The Phonetic Footprint of Covid-19
Interspeech 2021 (, August 30, 2021 - September 3, 2021)
In: Proc. Interspeech 2021 2021
DOI: 10.21437/Interspeech.2021-1488
BibTeX: Download
2020
Journal Articles
- Orozco-Arroyave JR., Vasquez Correa J., Klumpp P., Perez Toro PA., Escobar-Grisales D., Roth N., Ríos-Urrego CD., Strauß M., Carvajal-Castaño HA., Bayerl S., Castrillón-Osorio LR., Arias-Vergara T., Küderle A., López-Pabón FO., Parra-Gallego LF., Eskofier B., Gómez-Gómez LF., Schuster M., Nöth E.:
Apkinson: the smartphone application for telemonitoring Parkinson's patients through speech, gait and hands movement
In: Neurodegenerative Disease Management (2020)
ISSN: 1758-2024
DOI: 10.2217/nmt-2019-0037
BibTeX: Download - Arias-Vergara T., Klumpp P., Vasquez-Correa JC., Nöth E., Orozco-Arroyave JR., Schuster M.:
Multi-channel spectrograms for speech processing applications using deep learning methods
In: Pattern Analysis and Applications (2020)
ISSN: 1433-7541
DOI: 10.1007/s10044-020-00921-5
BibTeX: Download
Conference Contributions
- Klumpp P., Fritsch JD., Nöth E.:
ANN-based Alzheimer's disease classification from bag of words
13th ITG Conference on Speech Communication (Oldenburg, October 10, 2018 - October 12, 2018)
In: Speech Communication - 13th ITG-Fachtagung Sprachkommunikation 2020
BibTeX: Download - Klumpp P., Arias Vergara T., Vásquez-Correa JC., Pérez-Toro PA., Hönig FT., Nöth E., Orozco-Arroyave JR.:
Surgical mask detection with deep recurrent phonetic models
Interspeech 2020
In: Interspeech 2020 2020
BibTeX: Download - Klumpp P., Arias Vergara T., Vasquez Correa J., Perez Toro PA., Hönig FT., Nöth E., Orozco-Arroyave JR.:
Surgical mask detection with deep recurrent phonetic models
21st Annual Conference of the International Speech Communication Association, INTERSPEECH 2020
DOI: 10.21437/Interspeech.2020-1723
BibTeX: Download
2019
Conference Contributions
- Vásquez-Correa JC., Klumpp P., Arias-Vergara T., Strauss M., Küderle A., Roth N., Bayerl S., García-Ospina N., Perez Toro PA., Parra-Gallego LF., Rios-Urrego CD., Escobar-Grisales D., Orozco-Arroyave JR., Eskofier B., Nöth E.:
Apkinson: A mobile solution for multimodal assessment of patients with Parkinson's disease
20th Annual Conference of the International Speech Communication Association: Crossroads of Speech and Language, INTERSPEECH 2019 (Graz, September 15, 2019 - September 19, 2019)
In: Gernot Kubin, Thomas Hain, Bjorn Schuller, Dina El Zarka, Petra Hodl (ed.): Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2019
DOI: 10.21437/Interspeech.2019-8003
URL: https://www.isca-speech.org/archive/Interspeech_2019/abstracts/8003.html
BibTeX: Download - Klumpp P., Vasquez Correa J., Haderlein T., Nöth E.:
Feature space visualization with spatial similarity maps for pathological speech data
20th Annual Conference of the International Speech Communication Association: Crossroads of Speech and Language, INTERSPEECH 2019 (Graz, September 15, 2019 - September 19, 2019)
In: Gernot Kubin, Thomas Hain, Bjorn Schuller, Dina El Zarka, Petra Hodl (ed.): Proc. Interspeech 2019 2019
DOI: 10.21437/Interspeech.2019-2080
BibTeX: Download - Vasquez Correa J., Klumpp P., Orozco Arroyave JR., Nöth E.:
Phonet: A tool based on gated recurrent neural networks to extract phonological posteriors from speech
20th Annual Conference of the International Speech Communication Association: Crossroads of Speech and Language, INTERSPEECH 2019 (Graz, September 15, 2019 - September 19, 2019)
In: Gernot Kubin, Thomas Hain, Bjorn Schuller, Dina El Zarka, Petra Hodl (ed.): Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2019
DOI: 10.21437/Interspeech.2019-1405
BibTeX: Download
2018
Conference Contributions
- Klumpp P., Fritsch JD., Nöth E.:
ANN-based Alzheimer’s disease classification from bag of words
Speech Communication - 13. ITG-Fachtagung Sprachkommunikation
In: Speech Communication - 13. ITG-Fachtagung Sprachkommunikation 2018
URL: https://www.idiap.ch/~jfritsch/pdf/2018ITG.pdf
BibTeX: Download - Arias Vergara T., Vasquez Correa J., Orozco Arroyave JR., Klumpp P., Nöth E.:
Unobtrusive Monitoring of Speech Impairments of Parkinson's Disease Patients Through Mobile Devices
2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018
DOI: 10.1109/ICASSP.2018.8462332
BibTeX: Download - Arias Vergara T., Vasquez Correa J., Rafael Orozco-Arroyave J., Klumpp P., Nöth E.:
Unobtrusive Monitoring of Speech Impairments of Parkinson'S Disease Patients Through Mobile Devices
43rd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
DOI: 10.1109/ICASSP.2018.8462332
URL: https://ieeexplore.ieee.org/abstract/document/8462332
BibTeX: Download
2017
Conference Contributions
- Klumpp P., Janu T., Arias Vergara T., Vasquez Correa J., Rafael Orozco-Arroyave J., Nöth E.:
Apkinson — A Mobile Monitoring Solution for Parkinson's Disease
Interspeech 2017
In: Interspeech 2017 2017
URL: https://www.researchgate.net/profile/Juan_Vasquez12/publication/319185470_Apkinson_-_A_Mobile_Monitoring_Solution_for_Parkinson's_Disease/links/59b9fecfa6fdcc68723177dc/Apkinson-A-Mobile-Monitoring-Solution-for-Parkinsons-Disease.pdf
BibTeX: Download - Arias Vergara T., Klumpp P., Vasquez Correa J., Orozco Arroyave JR., Nöth E.:
Parkinson’s disease progression assessment from speech using a mobile device-based application
20th International Conference on Text, Speech and Dialogue, TSD 2017
In: TSD 2017: Text, Speech, and Dialogue 2017
DOI: 10.1007/978-3-319-64206-2_42
BibTeX: Download