Ronak Kosti
Ronak Kosti, Ph.D.
Researcher
Martensstr. 3
91058 Erlangen
Department of Computer Science
Chair of Computer Science 5 (Pattern Recognition)
Martensstr. 3
91058 Erlangen
- Phone number: +49 9131 85-27799
- Fax number: +49 9131 85-27270
- Email: ronak.kosti@fau.de
- Website: https://lme.tf.fau.de/person/kosti/
Academic CV
- Jan/2022 – Current:
Post-Doc Researcher at Kunstgeschichtliches Institut
Researcher for SPP “Image Synthesis as an Epistemic Method Towards Understanding Art” [Link English] Project. The SPP is a part of the larger Das Digitale Bild project. - May/2019 – Dec/2021:
Post-Doc Researcher at PRL
Co-Organizer of SUMAC Workshops (Flyer, Website)
Researcher for ICONOGRAPHICS Project
Researcher for SPP “Image Synthesis as an Epistemic Method Towards Understanding Art” [Link English] Project. The SPP is a part of the larger Das Digitale Bild project. - October/2015 – April/2019:
PhD Candidate at Universitat Oberta de Catalunya, Scene Understanding and Artificial Intelligence Lab (Link)
Projects
2019
-
ICONOGRAPHICS: Computational Understanding of Iconography and Narration in Visual Cultural Heritage
(FAU Funds)
Term: April 1, 2019 - March 31, 2021The interdisciplinary research project Iconographics is dedicated to innovative possibilities of digital image recognition for the arts and humanities. While computer vision is already often able to identify individual objects or specific artistic styles in images, the project is confronted with the open problem of also opening up the more complex image structures and contexts digitally. On the basis of a close interdisciplinary collaboration between Classical Archaeology, Christian Archaeology, Art History and the Computer Sciences, as well as joint theoretical and methodological reflection, a large number of multi-layered visual works will be analyzed, compared and contextualized. The aim is to make the complex compositional, narrative and semantic structures of these images tangible for computer vision.
Iconography and Narratology are identified as a challenging research questions for all subjects of the project. The iconography will be interpreted in its plot, temporality, and narrative logic. Due to its complex cultural structure; we selected four important scenes:
- The Annunciation of the Lord
- The Adoration of the Magi
- The Baptism of Christ
- Noli me tangere (Do not touch me)
EMOTIC (Emotion Recognition in Context)
- The goal of this project is providing machines with the ability of understanding what a person is feeling from his/her frame of reference, taking into account the scene context: where is this person, what is this person doing, how does this person look, etc
Project Details: Link
Publications
2024
Conference Contributions
- , , :
SUMAC '24: 6th workshop on the analySis, Understanding and proMotion of heritAge Contents: Advances in Machine Learning, Signal Processing, Multimodal Techniques and Human-machine
6th Workshop on the analySis, Understanding and proMotion of heritAge Contents, SUMAC 2024 (Melbourne, VIC, October 28, 2024 - November 1, 2024)
In: SUMAC 2024 - Proceedings of the 6th Workshop on the analySis, Understanding and proMotion of heritAge Contents, Co-Located with: MM 2024 2024
DOI: 10.1145/3689094.3696017
BibTeX: Download - , , :
SUMAC 24 Chairs Welcome
6th Workshop on the analySis, Understanding and proMotion of heritAge Contents, SUMAC 2024 (Melbourne, VIC, October 28, 2024 - November 1, 2024)
In: SUMAC 2024 - Proceedings of the 6th Workshop on the analySis, Understanding and proMotion of heritAge Contents, Co-Located with: MM 2024 2024
BibTeX: Download - , , , , , , , , , , , :
Unsupervised Domain Adaptation Using Soft-Labeled Contrastive Learning with Reversed Monte Carlo Method for Cardiac Image Segmentation
27th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2024 (Marrakesh, October 6, 2024 - October 10, 2024)
In: Marius George Linguraru, Qi Dou, Aasa Feragen, Stamatia Giannarou, Ben Glocker, Karim Lekadir, Julia A. Schnabel (ed.): Medical Image Computing and Computer Assisted Intervention – MICCAI 2024. 27th International Conference, Marrakesh, Morocco, October 6–10, 2024, Proceedings, Part IX, Cham: 2024
DOI: 10.1007/978-3-031-72114-4_65
BibTeX: Download
2022
Journal Articles
- , , , , , , :
ICC++: Explainable Feature Learning for Art History using Image Compositions
In: Pattern Recognition (2022), p. 109153
ISSN: 0031-3203
DOI: 10.1016/j.patcog.2022.109153
BibTeX: Download - , , , , , , , :
Enhancing Human Pose Estimation in Ancient Vase Paintings via Perceptually-grounded Style Transfer Learning
In: Journal of Computing and Cultural Heritage (2022)
ISSN: 1556-4673
DOI: 10.1145/3569089
BibTeX: Download
Conference Contributions
- , , :
SUMAC'22 Chairs' Welcome
4th ACM International Workshop on Structuring and Understanding of Multimedia heritAge Contents, SUMAC 2022 (Lisboa, October 10, 2022)
In: SUMAC 2022 - Proceedings of the 4th ACM International Workshop on Structuring and Understanding of Multimedia heritAge Contents 2022
BibTeX: Download - , , , , :
ARIN: Adaptive Resampling and Instance Normalization for Robust Blind Inpainting of Dunhuang Cave Paintings
2022 Eleventh International Conference on Image Processing Theory, Tools and Applications (IPTA) (Salzburg, April 19, 2022 - April 22, 2022)
DOI: 10.1109/IPTA54936.2022.9784144
BibTeX: Download - , , , , , , , , , , , :
One-Shot Object Detection in Heterogeneous Artwork Datasets
2022 Eleventh International Conference on Image Processing Theory, Tools and Applications (IPTA) (Salzburg, Austria, April 19, 2022 - April 22, 2022)
DOI: 10.1109/IPTA54936.2022.9784141
BibTeX: Download - , , , :
Few-shot Unsupervised Domain Adaptation for Multi-modal Cardiac Image Segmentation
German Workshop on Medical Image Computing, 2022 (Heidelberg, DEU, June 26, 2022 - June 28, 2022)
In: Klaus Maier-Hein, Thomas M. Deserno, Heinz Handels, Andreas Maier, Christoph Palm, Thomas Tolxdorff (ed.): Informatik aktuell 2022
DOI: 10.1007/978-3-658-36932-3_5
BibTeX: Download - , , , , , :
ODOR: The ICPR2022 ODeuropa Challenge on Olfactory Object Recognition
26th International Conference on Pattern Recognition / 8th International Workshop on Image Mining - Theory and Applications (IMTA) (Montreal)
In: 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), NEW YORK: 2022
DOI: 10.1109/ICPR56361.2022.9956542
BibTeX: Download - , , :
Supervised Contrastive Learning for Robust and Efficient Multi-modal Emotion and Sentiment Analysis
26th International Conference on Pattern Recognition / 8th International Workshop on Image Mining - Theory and Applications (IMTA) (Montreal, CANADA)
In: 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), NEW YORK: 2022
DOI: 10.1109/ICPR56361.2022.9956637
BibTeX: Download
2021
Journal Articles
- , , , , :
Adapt Everywhere: Unsupervised Adaptation of Point-Clouds and Entropy Minimisation for Multi-modal Cardiac Image Segmentation
In: IEEE transactions on medical imaging (2021)
ISSN: 1558-254X
DOI: 10.1109/TMI.2021.3066683
BibTeX: Download
Conference Contributions
- , , , :
SUMAC'21: 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents
29th ACM International Conference on Multimedia, MM 2021 (Online, October 20, 2021 - October 24, 2021)
In: MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia 2021
DOI: 10.1145/3474085.3478576
BibTeX: Download
2020
Conference Contributions
- , , , , :
SUMAC 20 Chairs Welcome
2nd ACM Workshop on Structuring and Understanding of Multimedia heritAge Contents, SUMAC 2020 (, October 12, 2020)
In: SUMAC 2020 - Proceedings of the 2nd Workshop on Structuring and Understanding of Multimedia heritAge Contents 2020
BibTeX: Download - , , , , , :
Understanding Compositional Structures in Art Historical Images Using Pose and Gaze Priors
ECCV 2020 (Glasgow, August 23, 2020 - August 28, 2020)
In: Andrea Vedaldi, Horst Bischof, Thomas Brox, Jan-Michael Frahm (ed.): Computer Vision – ECCV 2020 Workshops. ECCV 2020, Switzerland: 2020
DOI: 10.1007/978-3-030-66096-3_9
URL: https://link.springer.com/chapter/10.1007/978-3-030-66096-3_9
BibTeX: Download - , , , , :
Computer Vision Understanding of Narrative Strategies on Greek Vases
48th Computer Applications and Quantitative Methods in Archaeology Conference (Oxford, UK, April 14, 2020 - April 17, 2020)
In: Computer Applications and Quantitative Methods in Archaeology 2020
BibTeX: Download - , , , , , , :
Deep Learning based Attribute Representation in Ancient Vase Paintings
Digital Humanities 2020 - Intersections/Carrefours (Ottawa, Canada, July 22, 2020 - July 24, 2020)
In: Digital Humanities 2020 - Intersections/Carrefours 2020
BibTeX: Download - , , , , , :
Towards Image Caption Generation for Art Historical Data
URL: https://aidh.kinf.wiai.uni-bamberg.de/02_Gupta_et_al_Towards_Image_Caption_Generation_etc.pdf
BibTeX: Download
2019
Journal Articles
- Ronak Kosti, Jose Alvarez, Adria Recasens, Agata Lapedriza:
Context Based Emotion Recognition using EMOTIC Dataset
In: IEEE Transactions on Pattern Analysis and Machine Intelligence (2019)
ISSN: 0162-8828
DOI: 10.1109/TPAMI.2019.2916866
URL: https://ieeexplore.ieee.org/document/8713881/keywords#keywords
BibTeX: Download
Conference Contributions
- , , , , , :
Recognizing Characters in Art History Using Deep Learning
SUMAC 2019 - The 1st workshop on Structuring and Understanding of Multimedia heritAge Contents (Nice, October 21, 2019 - October 25, 2019)
In: Recognizing Characters in Art History Using Deep Learning 2019
DOI: 10.1145/3347317.3357242
BibTeX: Download
2017
Conference Contributions
- Kosti R., Alvarez J., Recasens A., Lapedriza A.:
EMOTIC: Emotions in Context Dataset
30th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2017
DOI: 10.1109/CVPRW.2017.285
BibTeX: Download - Kosti R., Alvarez J., Recasens A., Lapedriza A.:
Emotion recognition in context
30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017
DOI: 10.1109/CVPR.2017.212
BibTeX: Download
Lectures
Computer Vision Lectures for Summer Semester 2020
1
/
11
Intro to Computer Vision (Lecture 1, Part 1)
Intro to Computer Vision (Lecture 1, Part 2)
Image and Light (Lecture 2, Part 1)
1
/
11
No matching records found.
Open Projects/Thesis Topics
Running Thesis/Projects:
Find different projects/topics for Forschungspraktikum, Bachelors/Masters thesis at this link: Google Drive Link
These projects will be co-supervised by Prathmesh Madhu