ETI funding: “A multimodal approach for automatic generation of radiology reports using chest X-ray images, clinical free-text, and spoken commands”
The Pattern Recognition Lab is happy to announce that the Emerging Talents Initiative (ETI) from FAU, has granted funding to the research project entitled “A multimodal approach for automatic generation of radiology reports using chest X-ray images, clinical free-text, and spoken commands”.
Project Overview
The project, led by Tomás Arias-Vergara and mentored by Professor Andreas Maier, Chair of Computer Science 5 (Pattern Recognition Lab) at FAU, aims to implement a multimodal AI-based model that combines text and images to generate free-text radiology reports and incorporate spoken commands to improve the quality of the generated reports using automatic speech recognition.
Goals and Methodology
The proposed funding project aims to automatically generate radiology reports using X-ray images and spoken commands. Specifically, this project aims to:
• Implement a multimodal AI-based model that combines text and images to generate free-text radiology reports.
• Investigate the suitability of the proposed system to detect and assess different clinical conditions from chest X-rays.
• Incorporate spoken commands to improve the quality of the generated reports.
Funding and support
ETI is a FAU program aimed at helping excellent young researchers apply for external funding and give them the possibility to promote an innovative project independently and extend their academic independence. ETI has funded this project for a period of 12 months.