Publications

2024	Compositional Generalization in Multimodal Models. Semih Yagcioglu, Osman Batur Ince, Aykut Erdem, Erkut Erdem, Desmond Elliott, and Deniz Yuret. Proceedings of NAACL.
2024	PAELLA: Parameter-Efficient Lightweight Language-Agnostic Captioning Model. Rita Ramos, Emanuele Bugliarello, Bruno Martins, and Desmond Elliott. Findings of NAACL.
2024	The Role of Data Curation in Image Captioning. Wenyan Li, Jonas Lotz, Chen Qiu, and Desmond Elliott. Proceedings of EACL.
2023	Text Rendering Strategies for Pixel Language Models. Jonas F. Lotz, Elizabeth Salesky, Phillip Rust, and Desmond Elliott. Proceedings of EMNLP.
2023	Evaluating Bias and Fairness in Gender-Neutral Pretrained Vision-and-Language Models. Laura Cabello, Emanuele Bugliarello, Stephanie Brandl, and Desmond Elliott. Proceedings of EMNLP.
2023	PHD: Pixel-Based Language Modeling of Historical Documents. Nadav Borenstein, Phillip Rust, Desmond Elliott, and Isabelle Augenstein. Proceedings of EMNLP.
2023	Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation. Tosho Hirasawa, Emanuele Bugliarello, Desmond Elliott, and Mamoru Komachi. Proceedings of WMT.
2023	LMCap: Few-shot Multilingual Image Captioning by Retrieval Augmented Language Model Prompting. Rita Ramos, Bruno Martins, and Desmond Elliott. Findings of ACL.
2023	SmallCap: Lightweight Image Captioning Prompted With Retrieval Augmentation. Rita Ramos, Bruno Martins, Desmond Elliott, and Yova Kementchedjhieva. Proceedings of CVPR.
2023	Language Modelling with Pixels. Phillip Rust, Jonas F. Lotz, Emanuele Bugliarello, Elizabeth Salesky, Miryam Lhoneux, and Desmond Elliott. Proceedings of ICLR. Notable Top 5% Paper.
2023	Cleaner Categories Improve Object Detection and Visual-Textual Grounding. Davide Rigoni, Desmond Elliott, and Stella Frank. Image Analysis.
2023	Retrieval-augmented Image Captioning. Rita Ramos, Desmond Elliott, and Bruno Martins. Proceedings of EACL.
2023	MultiFin: A Dataset for Multilingual Financial NLP. Rasmus Jørgensen, Oliver Brandt, Mareike Hartmann, Xiang Dai, Christian Igel, and Desmond Elliott. Findings of EACL.
2022	Multilingual Multimodal Learning with Machine Translated Text. Chen Qiu, Dan Oneață, Emanuele Bugliarello, Stella Frank, and Desmond Elliott. Findings of EMNLP.
2022	Revisiting Transformer-based Models for Long Document Classification. Xiang Dai, Ilias Chalkidis, Sune Darkner, and Desmond Elliott. Findings of EMNLP.
2022	Date Recognition in Historical Parish Records. Laura Cabello Piqueras, Constanza Fierro, Jonas F. Lotz, Phillip Rust, Joen Rommedahl, Jeppe Klok Due, Christian Igel, Desmond Elliott, Carsten B. Pedersen, Israfel Salazar, and Anders Søgaard. Frontiers in Handwriting Recognition.
2022	IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages. Emanuele Bugliarello, Fangyu Liu, Jonas Pfeiffer, Siva Reddy, Desmond Elliott, Edoardo Maria Ponti, and Ivan Vulić. Proceedings of ICML.
2021	Visually Grounded Reasoning across Languages and Cultures. Fangyu Liu, Emanuele Bugliarello, Edoardo Maria Ponti, Siva Reddy, Nigel Collier, and Desmond Elliott. Proceedings of EMNLP. Best Paper Award.
2021	Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers. Stella Frank, Emanuele Bugliarello, and Desmond Elliott. Proceedings of EMNLP.
2021	mDAPT: Multilingual Domain Adaptive Pretraining in a Single Model. Rasmus Kær Jørgensen, Mareike Hartmann, Xiang Dai, and Desmond Elliott. Findings of EMNLP.
2021	The added effect of artificial intelligence on physicians’ performance in detecting thoracic pathologies on CT and chest X-ray: A systematic review. Dana Li, Lea Marie Pehrson, Carsten Ammitzbøl Lauridsen, Lea Tøttrup, Marco Fraccaro, Desmond Elliott, Hubert Dariusz Zając, Sune Darkner, Jonathan Frederik Carlsen, and Michael Bachmann Nielsen. Diagnostics 11(12).
2021	Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Language BERTs. Emanuele Bugliarello, Ryan Cotterell, Naoaki Okazaki, and Desmond Elliott. TACL.
2021	The Role of Syntactic Planning in Compositional Image Captioning. Emanuele Bugliarello and Desmond Elliott. Proceedings of EACL.
2020	Fine-Grained Grounding for Multimodal Speech Recognition. Tejas Srinivasan, Ramon Sanabria, Florian Metze, and Desmond Elliott. Findings of EMNLP.
2020	Textual Supervision for Visually Grounded Spoken Language Understanding. Bertrand Higy, Desmond Elliott, and Grzegorz Chrupała. Findings of EMNLP.
2020	Multimodal Machine Translation through Visuals and Speech. Umut Sulubacak, Ozan Caglayan, Stig-Arne Grönroos, Aku Rouhe, Desmond Elliott, Lucia Specia, and Jörg Tiedemann. Machine Translation 34(2-3).
2020	CompGuessWhat?!: A Multi-task Evaluation Framework for Grounded Language Learning. Alessandro Suglia, Ioannis Konstas, Andrea Vanzo, Emanuele Bastianelli, Desmond Elliott, Stella Frank, and Oliver Lemon. Proceedings of ACL.
2020	The Sensitivity of Language Models and Humans to Winograd Schema Perturbations. Mostafa Abdou, Vinit Ravishankar, Maria Barrett, Yonatan Belinkov, Desmond Elliott, and Anders Søgaard. Proceedings of ACL.
2020	Grounded Sequence to Sequence Transduction. Lucia Specia, Loic Barrault, Ozan Caglayan, Amanda Duarte, Desmond Elliott, Spandana Gella, Nils Holzenberger, Chiraag Lala, Sun Jae Lee, Jindrich Libovicky, Pranava Madhyastha, Florian Metze, Karl Mulligan, Alissa Ostapenko, Shruti Palaskar, Ramon Sanabria, Josiah Wang, and Raman Arora. IEEE Journal of Selected Topics in Signal Processing 14(3).
2019	Compositional Generalization in Image Captioning. Mitja Nikolaus, Mostafa Abdou, Matthew Lamm, Rahul Aralikatte, and Desmond Elliott. Proceedings of CoNLL.
2019	Adversarial Removal of Demographic Attributes Revisited. Maria Barrett, Yova Kementchedjhieva, Yanai Elazar, Desmond Elliott, and Anders Søgaard. Proceedings of EMNLP.
2019	Cross-lingual Visual Verb Sense Disambiguation. Spandana Gella, Desmond Elliott, and Frank Keller. Proceedings of NAACL.
2018	How2: A Large-scale Dataset for Multimodal Language Understanding. Ramon Sanabria, Ozan Caglayan, Shruti Palaskar, Desmond Elliott, Loïc Barrault, Lucia Specia, and Florian Metze. NeurIPS Workshop on Visually Grounded Interaction and Language.
2018	Talking about other people: an endless range of possibilities. Emiel Miltenburg, Desmond Elliott, and Piek Vossen. Proceedings of INLG.
2018	Adversarial Evaluation of Multimodal Machine Translation. Desmond Elliott. Proceedings of EMNLP.
2018	Lessons Learned in Multilingual Grounded Language Learning. Ákos Kádár, Desmond Elliott, Marc-Alexandre Côté, Grzegorz Chrupała, and Afra Alishahi. Proceedings of CoNLL.
2018	Findings of the Third Shared Task on Multimodal Machine Translation. Loïc Barrault, Fethi Bougares, Lucia Specia, Chiraag Lala, Desmond Elliott, and Stella Frank. Proceedings of WMT.
2018	Measuring the Diversity of Automatic Image Descriptions. Emiel Miltenburg, Desmond Elliott, and Piek Vossen. Proceedings of COLING. Area Chair Favourite Paper.
2018	Assessing multilingual multimodal image description: Studies of native speaker preferences and translator choices. Stella Frank, Desmond Elliott, and Lucia Specia. Natural Language Engineering 24(3).