Ronak Kosti, Ph.D.
https://orcid.org/0000-0002-9550-5284
2019
-
ICONOGRAPHICS: Computational Understanding of Iconography and Narration in Visual Cultural Heritage
(FAU Funds)
Term: April 1, 2019 - March 31, 2021The interdisciplinary research project Iconographics is dedicated to innovative possibilities of digital image recognition for the arts and humanities. While computer vision is already often able to identify individual objects or specific artistic styles in images, the project is confronted with the open problem of also opening up the more complex image structures and contexts digitally. On the basis of a close interdisciplinary collaboration between Classical Archaeology, Christian Archaeology, Art History and the Computer Sciences, as well as joint theoretical and methodological reflection, a large number of multi-layered visual works will be analyzed, compared and contextualized. The aim is to make the complex compositional, narrative and semantic structures of these images tangible for computer vision.
Iconography and Narratology are identified as a challenging research questions for all subjects of the project. The iconography will be interpreted in its plot, temporality, and narrative logic. Due to its complex cultural structure; we selected four important scenes:
- The Annunciation of the Lord
- The Adoration of the Magi
- The Baptism of Christ
- Noli me tangere (Do not touch me)
- The goal of this project is providing machines with the ability of understanding what a person is feeling from his/her frame of reference, taking into account the scene context: where is this person, what is this person doing, how does this person look, etc
Project Details: Link
2020
Conference Contributions
SUMAC 20 Chairs Welcome
2nd ACM Workshop on Structuring and Understanding of Multimedia heritAge Contents, SUMAC 2020 (, October 12, 2020)
In: SUMAC 2020 - Proceedings of the 2nd Workshop on Structuring and Understanding of Multimedia heritAge Contents 2020
BibTeX: Download
, , , , :
Deep Learning based Attribute Representation in Ancient Vase Paintings
Digital Humanities 2020 - Intersections/Carrefours (Ottawa, Canada, July 22, 2020 - July 24, 2020)
In: Digital Humanities 2020 - Intersections/Carrefours 2020
BibTeX: Download
, , , , , , :
Computer Vision Understanding of Narrative Strategies on Greek Vases
48th Computer Applications and Quantitative Methods in Archaeology Conference (Oxford, UK, April 14, 2020 - April 17, 2020)
In: Computer Applications and Quantitative Methods in Archaeology 2020
BibTeX: Download
, , , , :
2019
Journal Articles
- Ronak Kosti, Jose Alvarez, Adria Recasens, Agata Lapedriza:
Context Based Emotion Recognition using EMOTIC Dataset
In: IEEE Transactions on Pattern Analysis and Machine Intelligence (2019)
ISSN: 0162-8828
DOI: 10.1109/TPAMI.2019.2916866
URL: https://ieeexplore.ieee.org/document/8713881/keywords#keywords
BibTeX: Download
Conference Contributions
Recognizing Characters in Art History Using Deep Learning
SUMAC 2019 - The 1st workshop on Structuring and Understanding of Multimedia heritAge Contents (Nice, October 21, 2019 - October 25, 2019)
In: Recognizing Characters in Art History Using Deep Learning 2019
DOI: 10.1145/3347317.3357242
BibTeX: Download
, , , , , :
2017
Conference Contributions
- Kosti R., Alvarez J., Recasens A., Lapedriza A.:
EMOTIC: Emotions in Context Dataset
30th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2017
DOI: 10.1109/CVPRW.2017.285
BibTeX: Download - Kosti R., Alvarez J., Recasens A., Lapedriza A.:
Emotion recognition in context
30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017
DOI: 10.1109/CVPR.2017.212
BibTeX: Download





Seminar (SEM)
-
Seminar Deep Learning Theory & Applications
Information regarding the online teaching will be added to the studon course
- Wed 10:15-11:45, Room 01.019
Title | Type | Status | Student |
---|---|---|---|
Content-based Image Retrieval based on compositional elements for art historical images | BA thesis | open | Tilman Marquart |
Pose Based Image Retrieval in Greek Vase Paintings | MA thesis | finished | Angel Villar-Corrales |
Adversarial Modeling of Emotions in Visual Scenes | BA thesis | finished | Benedikt Mielke |
Emotion Recognition Guided by Gaze and Context on Images | MA thesis | finished | Luis Carlos Rivera Monroy |
Find different projects/topics for Forschungspraktikum, Bachelors/Masters thesis at this link: Google Drive Link
These projects will be co-supervised by Prathmesh Madhu