We are the Language and Multimodal Processing Group at the Department of Computer Science at the University of Copenhagen. Our recent work includes representation learning for multilingual and multimodal data, resource creation, and language modelling.


Older posts…

Research Areas

Pixel Language Models

We are developing language models that can process any written language.

Read more »

Retrieval Augmentation

Retrieval augmentation of multimodal models for image captioning.

Read more »

Multilingual Multimodality

Design, understand, and evaluate multimodality in multilingual models

Read more »

Recent Publications

LMCap: Few-shot Multilingual Image Captioning by Retrieval Augmented Language Model Prompting.
Rita Ramos, Bruno Martins, and Desmond Elliott.
Findings of ACL.
SmallCap: Lightweight Image Captioning Prompted With Retrieval Augmentation.
Rita Ramos, Bruno Martins, Desmond Elliott, and Yova Kementchedjhieva.
Proceedings of CVPR.
Language Modelling with Pixels.
Phillip Rust, Jonas F. Lotz, Emanuele Bugliarello, Elizabeth Salesky, Miryam Lhoneux, and Desmond Elliott.
Proceedings of ICLR. Notable Top 5% Paper.
Cleaner Categories Improve Object Detection and Visual-Textual Grounding.
Davide Rigoni, Desmond Elliott, and Stella Frank.
Image Analysis.
Retrieval-augmented Image Captioning.
Rita Ramos, Desmond Elliott, and Bruno Martins.
Proceedings of EACL.
MultiFin: A Dataset for Multilingual Financial NLP.
Rasmus Jørgensen, Oliver Brandt, Mareike Hartmann, Xiang Dai, Christian Igel, and Desmond Elliott.
Findings of EACL.


Desmond Elliott
Assistant Professor

Graduate Students

Emanuele Bugliarello
Ph.D Fellow
(co-advised with Anders Søgaard)
Rita Ramos
Rita Ramos
Ph.D Fellow
(co-advised with Bruno Martins)
Wenyan Li
Ph.D Fellow
(co-advised with Anders Søgaard)
Jonas F. Lotz
Jonas F. Lotz
Ph.D Fellow
(co-advised with Christian Igel)


Stella Frank University of Copenhagen
Bruno Martins Instituto Superior Técnico
CoAStaL University of Copenhagen


Emiel van Miltenburg Ph.D., 2018. Now at Tilburg University.
Xiang Dai Postdoc. Now Research Scientist at CSIRO Data61
Elham Pezhhan Digitaliseringskonsulent at Thisted Kommune
Mitja Nikolaus Now Ph.D Fellow at Aix-Marseille University