LAMP: Home

We are the Language and Multimodal Processing Group at the Department of Computer Science at the University of Copenhagen. Our recent work includes representation learning for multilingual and multimodal data, resource creation, and language modelling.

News

August 21, 2023
Hiring a postdoc to work on pixel-based language models. Applications due on August 31.
May 01, 2023
One paper accepted to Findings of ACL on multilingual image captioning without training an image captioning model. Congratulations to Rita!
February 27, 2023
We have one paper accepted at CVPR 2023 on retrieval-augmented image captioning. Congratulations Rita!
January 21, 2023
One paper accepted at ICLR on pixel-based language modelling. Congratulations to Phillip!

Older posts…

Research Areas

Pixel Language Models

We are developing language models that can process any written language.

Retrieval Augmentation

Retrieval augmentation of multimodal models for image captioning.

Multilingual Multimodality

Design, understand, and evaluate multimodality in multilingual models

Recent Publications

2023	LMCap: Few-shot Multilingual Image Captioning by Retrieval Augmented Language Model Prompting. Rita Ramos, Bruno Martins, and Desmond Elliott. Findings of ACL.
2023	SmallCap: Lightweight Image Captioning Prompted With Retrieval Augmentation. Rita Ramos, Bruno Martins, Desmond Elliott, and Yova Kementchedjhieva. Proceedings of CVPR.
2023	Language Modelling with Pixels. Phillip Rust, Jonas F. Lotz, Emanuele Bugliarello, Elizabeth Salesky, Miryam Lhoneux, and Desmond Elliott. Proceedings of ICLR. Notable Top 5% Paper.
2023	Cleaner Categories Improve Object Detection and Visual-Textual Grounding. Davide Rigoni, Desmond Elliott, and Stella Frank. Image Analysis.
2023	Retrieval-augmented Image Captioning. Rita Ramos, Desmond Elliott, and Bruno Martins. Proceedings of EACL.
2023	MultiFin: A Dataset for Multilingual Financial NLP. Rasmus Jørgensen, Oliver Brandt, Mareike Hartmann, Xiang Dai, Christian Igel, and Desmond Elliott. Findings of EACL.

Faculty

Desmond Elliott

Assistant Professor

Graduate Students

Emanuele Bugliarello

Ph.D Fellow

(co-advised with Anders Søgaard)

Rita Ramos

Ph.D Fellow

(co-advised with Bruno Martins)

Wenyan Li

Ph.D Fellow

(co-advised with Anders Søgaard)

Jonas F. Lotz

Ph.D Fellow

(co-advised with Christian Igel)

Collaborators

Stella Frank University of Copenhagen

Bruno Martins Instituto Superior Técnico

CoAStaL University of Copenhagen

Alumni

Emiel van Miltenburg Ph.D., 2018. Now at Tilburg University.

Xiang Dai Postdoc. Now Research Scientist at CSIRO Data61

Elham Pezhhan Digitaliseringskonsulent at Thisted Kommune

Mitja Nikolaus Now Ph.D Fellow at Aix-Marseille University