A Report on the FigLang 2022 Shared Task on Understanding Figurative Language

Arkadiy Saakyan; Tuhin Chakrabarty; Debanjan Ghosh; Smaranda Muresan

A Report on the FigLang 2022 Shared Task on Understanding Figurative Language

Arkadiy Saakyan
, Tuhin Chakrabarty
, Debanjan Ghosh
, Smaranda Muresan

Computer Science

Columbia University
Educational Testing Service

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

8 Scopus citations

Abstract

We present the results of the Shared Task on Understanding Figurative Language that we conducted as a part of the 3rd Workshop on Figurative Language Processing (FigLang 2022) at EMNLP 2022. The shared task is based on the FLUTE dataset (Chakrabarty et al., 2022), which consists of NLI pairs containing figurative language along with free text explanations for each NLI instance. The task challenged participants to build models that are able to not only predict the right label for a figurative NLI instance, but also generate a convincing free-text explanation. The participants were able to significantly improve upon provided baselines in both automatic and human evaluation settings. We further summarize the submitted systems and discuss the evaluation results.

Original language	English
Title of host publication	FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop
Publisher	Association for Computational Linguistics (ACL)
Pages	178-183
Number of pages	6
ISBN (Electronic)	9781959429111
State	Published - 2022
Event	3rd Workshop on Figurative Language Processing, FigLang 2022, as part of EMNLP 2022 - Abu Dhabi, United Arab Emirates Duration: Dec 8 2022 → …

Publication series

Name	FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop

Conference

Conference	3rd Workshop on Figurative Language Processing, FigLang 2022, as part of EMNLP 2022
Country/Territory	United Arab Emirates
City	Abu Dhabi
Period	12/8/22 → …

Cite this

Saakyan, A., Chakrabarty, T., Ghosh, D., & Muresan, S. (2022). A Report on the FigLang 2022 Shared Task on Understanding Figurative Language. In FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop (pp. 178-183). (FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop). Association for Computational Linguistics (ACL).

Saakyan, Arkadiy ; Chakrabarty, Tuhin ; Ghosh, Debanjan et al. / A Report on the FigLang 2022 Shared Task on Understanding Figurative Language. FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop. Association for Computational Linguistics (ACL), 2022. pp. 178-183 (FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop).

@inproceedings{471e657ad6b94e979bac3b9045ad6af7,

title = "A Report on the FigLang 2022 Shared Task on Understanding Figurative Language",

abstract = "We present the results of the Shared Task on Understanding Figurative Language that we conducted as a part of the 3rd Workshop on Figurative Language Processing (FigLang 2022) at EMNLP 2022. The shared task is based on the FLUTE dataset (Chakrabarty et al., 2022), which consists of NLI pairs containing figurative language along with free text explanations for each NLI instance. The task challenged participants to build models that are able to not only predict the right label for a figurative NLI instance, but also generate a convincing free-text explanation. The participants were able to significantly improve upon provided baselines in both automatic and human evaluation settings. We further summarize the submitted systems and discuss the evaluation results.",

author = "Arkadiy Saakyan and Tuhin Chakrabarty and Debanjan Ghosh and Smaranda Muresan",

note = "Publisher Copyright: {\textcopyright} 2022 Association for Computational Linguistics.; 3rd Workshop on Figurative Language Processing, FigLang 2022, as part of EMNLP 2022 ; Conference date: 08-12-2022",

year = "2022",

language = "English",

series = "FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop",

publisher = "Association for Computational Linguistics (ACL)",

pages = "178--183",

booktitle = "FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop",

}

Saakyan, A, Chakrabarty, T, Ghosh, D & Muresan, S 2022, A Report on the FigLang 2022 Shared Task on Understanding Figurative Language. in FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop. FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop, Association for Computational Linguistics (ACL), pp. 178-183, 3rd Workshop on Figurative Language Processing, FigLang 2022, as part of EMNLP 2022, Abu Dhabi, United Arab Emirates, 12/8/22.

A Report on the FigLang 2022 Shared Task on Understanding Figurative Language. / Saakyan, Arkadiy; Chakrabarty, Tuhin; Ghosh, Debanjan et al.
FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop. Association for Computational Linguistics (ACL), 2022. p. 178-183 (FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A Report on the FigLang 2022 Shared Task on Understanding Figurative Language

AU - Saakyan, Arkadiy

AU - Chakrabarty, Tuhin

AU - Ghosh, Debanjan

AU - Muresan, Smaranda

PY - 2022

Y1 - 2022

N2 - We present the results of the Shared Task on Understanding Figurative Language that we conducted as a part of the 3rd Workshop on Figurative Language Processing (FigLang 2022) at EMNLP 2022. The shared task is based on the FLUTE dataset (Chakrabarty et al., 2022), which consists of NLI pairs containing figurative language along with free text explanations for each NLI instance. The task challenged participants to build models that are able to not only predict the right label for a figurative NLI instance, but also generate a convincing free-text explanation. The participants were able to significantly improve upon provided baselines in both automatic and human evaluation settings. We further summarize the submitted systems and discuss the evaluation results.

AB - We present the results of the Shared Task on Understanding Figurative Language that we conducted as a part of the 3rd Workshop on Figurative Language Processing (FigLang 2022) at EMNLP 2022. The shared task is based on the FLUTE dataset (Chakrabarty et al., 2022), which consists of NLI pairs containing figurative language along with free text explanations for each NLI instance. The task challenged participants to build models that are able to not only predict the right label for a figurative NLI instance, but also generate a convincing free-text explanation. The participants were able to significantly improve upon provided baselines in both automatic and human evaluation settings. We further summarize the submitted systems and discuss the evaluation results.

UR - https://www.scopus.com/pages/publications/85153236337

M3 - Conference contribution

AN - SCOPUS:85153236337

T3 - FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop

SP - 178

EP - 183

BT - FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop

PB - Association for Computational Linguistics (ACL)

T2 - 3rd Workshop on Figurative Language Processing, FigLang 2022, as part of EMNLP 2022

Y2 - 8 December 2022

ER -

Saakyan A, Chakrabarty T, Ghosh D, Muresan S. A Report on the FigLang 2022 Shared Task on Understanding Figurative Language. In FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop. Association for Computational Linguistics (ACL). 2022. p. 178-183. (FLP 2022 - 3rd Workshop on Figurative Language Processing, Proceedings of the Workshop).

A Report on the FigLang 2022 Shared Task on Understanding Figurative Language

Abstract

Publication series

Conference

Other files and links

Fingerprint

Cite this