A Couch Potato is not a Potato on a Couch: Prompting Strategies, Image Generation, and Compositionality Prediction for Noun Compounds
Sinan Kurtyigit, Diego Frassinelli, Carina Silberer, Sabine Schulte Im Walde
Findings of the Association for Computational Linguistics: ACL 2025, pp. 10766–10776, 2025.
Abstract
We explore the role of the visual modality and of vision transformers in predicting the compositionality of English noun compounds. Crucially, we contribute a framework to address the challenge of obtaining adequate images that represent non-compositional compounds (such as “couch potato”), making it relevant for any image-based approach targeting figurative language. Our method uses prompting strategies and diffusion models to generate images. Comparing and combining our approach with a state-of-the-art text-based approach reveals complementary contributions regarding features as well as degrees of abstractness in compounds.Links
BibTeX
@inproceedings{kurtyigit-etal-2025-couch,
title = {A Couch Potato is not a Potato on a Couch: Prompting Strategies, Image Generation, and Compositionality Prediction for Noun Compounds},
author = {Kurtyigit, Sinan and Frassinelli, Diego and Silberer, Carina and Schulte Im Walde, Sabine},
editor = {Che, Wanxiang and Nabende, Joyce and Shutova, Ekaterina and Pilehvar, Mohammad Taher},
booktitle = {Findings of the Association for Computational Linguistics: ACL 2025},
year = {2025},
address = {Vienna, Austria},
publisher = {Association for Computational Linguistics},
url = {https://aclanthology.org/2025.findings-acl.561/},
doi = {10.18653/v1/2025.findings-acl.561},
pages = {10766--10776},
isbn = {979-8-89176-256-5}
}