Ronak Kosti, Ph.D.
Department of Computer Science
Chair of Computer Science 5 (Pattern Recognition)
Martensstr. 3
91058 Erlangen
- Phone number: +49 9131 85 27799
- Fax number: +49 9131 85 27270
- Email: ronak.kosti@fau.de
- Website: https://lme.tf.fau.de/person/kosti/
https://orcid.org/0000-0002-9550-5284
- May/2019 – Current:
Post-Doc Researcher at PRL
Co-Organizer of SUMAC Workshops (Flyer, Website)
Researcher for ICONOGRAPHICS Project
Researcher for SPP “Image Synthesis as an Epistemic Method Towards Understanding Art” [Link English] Project. The SPP is a part of the larger Das Digitale Bild project. - October/2015 – April/2019:
PhD Candidate at Universitat Oberta de Catalunya, Scene Understanding and Artificial Intelligence Lab (Link)
2019
-
ICONOGRAPHICS: Computational Understanding of Iconography and Narration in Visual Cultural Heritage
(FAU Funds)
Term: April 1, 2019 - March 31, 2021The interdisciplinary research project Iconographics is dedicated to innovative possibilities of digital image recognition for the arts and humanities. While computer vision is already often able to identify individual objects or specific artistic styles in images, the project is confronted with the open problem of also opening up the more complex image structures and contexts digitally. On the basis of a close interdisciplinary collaboration between Classical Archaeology, Christian Archaeology, Art History and the Computer Sciences, as well as joint theoretical and methodological reflection, a large number of multi-layered visual works will be analyzed, compared and contextualized. The aim is to make the complex compositional, narrative and semantic structures of these images tangible for computer vision.
Iconography and Narratology are identified as a challenging research questions for all subjects of the project. The iconography will be interpreted in its plot, temporality, and narrative logic. Due to its complex cultural structure; we selected four important scenes:
- The Annunciation of the Lord
- The Adoration of the Magi
- The Baptism of Christ
- Noli me tangere (Do not touch me)
- The goal of this project is providing machines with the ability of understanding what a person is feeling from his/her frame of reference, taking into account the scene context: where is this person, what is this person doing, how does this person look, etc
Project Details: Link
2021
Journal Articles
- , , , , :
Adapt Everywhere: Unsupervised Adaptation of Point-Clouds and Entropy Minimisation for Multi-modal Cardiac Image Segmentation
In: IEEE transactions on medical imaging (2021)
ISSN: 1558-254X
DOI: 10.1109/TMI.2021.3066683
BibTeX: Download
2020
Conference Contributions
- , , , , :
SUMAC 20 Chairs Welcome
2nd ACM Workshop on Structuring and Understanding of Multimedia heritAge Contents, SUMAC 2020 (, October 12, 2020)
In: SUMAC 2020 - Proceedings of the 2nd Workshop on Structuring and Understanding of Multimedia heritAge Contents 2020
BibTeX: Download - , , , , , :
Understanding Compositional Structures in Art Historical Images Using Pose and Gaze Priors
ECCV 2020 (Glasgow, August 23, 2020 - August 28, 2020)
In: Andrea Vedaldi, Horst Bischof, Thomas Brox, Jan-Michael Frahm (ed.): Computer Vision – ECCV 2020 Workshops. ECCV 2020, Switzerland: 2020
DOI: 10.1007/978-3-030-66096-3_9
URL: https://link.springer.com/chapter/10.1007/978-3-030-66096-3_9
BibTeX: Download - , , , , :
Computer Vision Understanding of Narrative Strategies on Greek Vases
48th Computer Applications and Quantitative Methods in Archaeology Conference (Oxford, UK, April 14, 2020 - April 17, 2020)
In: Computer Applications and Quantitative Methods in Archaeology 2020
BibTeX: Download - , , , , , , :
Deep Learning based Attribute Representation in Ancient Vase Paintings
Digital Humanities 2020 - Intersections/Carrefours (Ottawa, Canada, July 22, 2020 - July 24, 2020)
In: Digital Humanities 2020 - Intersections/Carrefours 2020
BibTeX: Download
2019
Journal Articles
- Ronak Kosti, Jose Alvarez, Adria Recasens, Agata Lapedriza:
Context Based Emotion Recognition using EMOTIC Dataset
In: IEEE Transactions on Pattern Analysis and Machine Intelligence (2019)
ISSN: 0162-8828
DOI: 10.1109/TPAMI.2019.2916866
URL: https://ieeexplore.ieee.org/document/8713881/keywords#keywords
BibTeX: Download
Conference Contributions
- , , , , , :
Recognizing Characters in Art History Using Deep Learning
SUMAC 2019 - The 1st workshop on Structuring and Understanding of Multimedia heritAge Contents (Nice, October 21, 2019 - October 25, 2019)
In: Recognizing Characters in Art History Using Deep Learning 2019
DOI: 10.1145/3347317.3357242
BibTeX: Download
2017
Conference Contributions
- Kosti R., Alvarez J., Recasens A., Lapedriza A.:
EMOTIC: Emotions in Context Dataset
30th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2017
DOI: 10.1109/CVPRW.2017.285
BibTeX: Download - Kosti R., Alvarez J., Recasens A., Lapedriza A.:
Emotion recognition in context
30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017
DOI: 10.1109/CVPR.2017.212
BibTeX: Download
| Title | Type | Status | Student |
|---|---|---|---|
| Similarity and duplicate search in artwork images | MA thesis | open | Yinan Shao |
| Enhancing the robustness and efficiency of multimodal emotion estimation models | MA thesis | running | Ahmed Gomaa |
| Enhanced Generative Learning Methods for Real-World Super-Resolution Problems in Smartphone Images | BA thesis | running | Alexander Schmidt |
| Network Deconvolution as Sparse Representations for Medical Image Analysis | BA thesis | running | Emad Wahid |
| Continual Learning for Object Detection in Art Historical Images | MA thesis | running | Rami Mahfoud |
| Content-based Image Retrieval based on compositional elements for art historical images | BA thesis | finished | Tilman Marquart |
| Pose Based Image Retrieval in Greek Vase Paintings | MA thesis | finished | Angel Villar-Corrales |
| Adversarial Modeling of Emotions in Visual Scenes | BA thesis | finished | Benedikt Mielke |
| Emotion Recognition Guided by Gaze and Context on Images | MA thesis | finished | Luis Carlos Rivera Monroy |
Find different projects/topics for Forschungspraktikum, Bachelors/Masters thesis at this link: Google Drive Link
These projects will be co-supervised by Prathmesh Madhu