TY - GEN
T1 - Figurative Language in Recognizing Textual Entailment
AU - Chakrabarty, Tuhin
AU - Ghosh, Debanjan
AU - Poliak, Adam
AU - Muresan, Smaranda
N1 - Publisher Copyright:
© 2021 Association for Computational Linguistics
PY - 2021
Y1 - 2021
N2 - We introduce a collection of recognizing textual entailment (RTE) datasets focused on figurative language. We leverage five existing datasets annotated for a variety of figurative language - simile, metaphor, and irony - and frame them into over 12,500 RTE examples.We evaluate how well state-of-the-art models trained on popular RTE datasets capture different aspects of figurative language. Our results and analyses indicate that these models might not sufficiently capture figurative language, struggling to perform pragmatic inference and reasoning about world knowledge. Ultimately, our datasets provide a challenging testbed for evaluating RTE models.
AB - We introduce a collection of recognizing textual entailment (RTE) datasets focused on figurative language. We leverage five existing datasets annotated for a variety of figurative language - simile, metaphor, and irony - and frame them into over 12,500 RTE examples.We evaluate how well state-of-the-art models trained on popular RTE datasets capture different aspects of figurative language. Our results and analyses indicate that these models might not sufficiently capture figurative language, struggling to perform pragmatic inference and reasoning about world knowledge. Ultimately, our datasets provide a challenging testbed for evaluating RTE models.
UR - https://www.scopus.com/pages/publications/85115675442
U2 - 10.18653/v1/2021.findings-acl.297
DO - 10.18653/v1/2021.findings-acl.297
M3 - Conference contribution
AN - SCOPUS:85115675442
T3 - Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
SP - 3354
EP - 3361
BT - Findings of the Association for Computational Linguistics
A2 - Zong, Chengqing
A2 - Xia, Fei
A2 - Li, Wenjie
A2 - Navigli, Roberto
PB - Association for Computational Linguistics (ACL)
T2 - Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
Y2 - 1 August 2021 through 6 August 2021
ER -