We are the Language and Multimodal Processing Group at the Department of Computer Science at the University of Copenhagen. Our recent work includes representation learning for multilingual and multimodal data, resource creation, and language modelling.

News

Older posts…

Research Areas

Pixel Language Models

We are developing language models that can process any written language.

Jonas F. Lotz

Retrieval Augmentation

Retrieval augmentation of multimodal models for image captioning.

Rita Ramos

Multilingual Multimodality

Design, understand, and evaluate multimodality in multilingual models

Rita Ramos

Recent Publications

2024
 		FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture.
Wenyan Li, Crystina Zhang, Jiaang Li, Qiwei Peng, Raphael Tang, Li Zhou, Weijia Zhang, Guimin Hu, Yifei Yuan, Anders Søgaard, Daniel Hershcovich, and Desmond Elliott.
Proceedings of EMNLP.
2024
 		Understanding Retrieval Robustness for Retrieval-augmented Image Captioning.
Wenyan Li, Jiaang Li, Rita Ramos, Raphael Tang, and Desmond Elliott.
Proceedings of ACL.
2024
 		Classification of Medical Text in Small and Imbalanced Datasets in a Non-English Language.
Vincent Beliveau, Helene Kaas, Martin Prener, Claes Ladefoged, Desmond Elliott, Gitte M. Knudsen, Lars H. Pinborg, and Melanie Ganz.
Proceedings of MIDL.
2024
 		Compositional Generalization in Multimodal Models.
Semih Yagcioglu, Osman Batur Ince, Aykut Erdem, Erkut Erdem, Desmond Elliott, and Deniz Yuret.
Proceedings of NAACL.
2024
 		PAELLA: Parameter-Efficient Lightweight Language-Agnostic Captioning Model.
Rita Ramos, Emanuele Bugliarello, Bruno Martins, and Desmond Elliott.
Findings of NAACL.
2024
 		The Role of Data Curation in Image Captioning.
Wenyan Li, Jonas Lotz, Chen Qiu, and Desmond Elliott.
Proceedings of EACL.

Faculty

Desmond Elliott
Desmond Elliott
Associate Professor

Postdocs

Ilker Kessen
Ilker Kessen
Danae Sanchez Villegas
Danae Sanchez Villegas

Research Assistants

Alice Schiavone A
Alice Schiavone

Ph.D Students

Rita Ramos
Rita Ramos
(co-advised with Bruno Martins)
Wenyan Li
Wenyan Li
(co-advised with Anders Søgaard)
Jonas F. Lotz
Jonas F. Lotz
(co-advised with Christian Igel)
Konstantin Dobler K
Konstantin Dobler
(co-advised with Gerard de Melo)
Ingo Ziegler I
Ingo Ziegler
Israfel Salazar I
Israfel Salazar

Collaborators

Stella Frank University of Copenhagen
Bruno Martins Instituto Superior Técnico
CoAStaL University of Copenhagen

Alumni

Emanuele Bugliarello Ph.D 2023. Now Research Scientist at Google
Emiel van Miltenburg PhD 2018. Now at Tilburg University.
Xiang Dai Postdoc. Now Research Scientist at CSIRO Data61
Elham Pezhhan Digitaliseringskonsulent at Thisted Kommune
Mitja Nikolaus Now Ph.D Fellow at Aix-Marseille University