TY - GEN
T1 - Morphological Inflection
T2 - 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023
AU - Kodner, Jordan
AU - Payne, Sarah
AU - Khalifa, Salam
AU - Liu, Zoey
N1 - Publisher Copyright:
© 2023 Association for Computational Linguistics.
PY - 2023
Y1 - 2023
N2 - Morphological inflection is a popular task in sub-word NLP with both practical and cognitive applications. For years now, state-of-the-art systems have reported high, but also highly variable, performance across data sets and languages. We investigate the causes of this high performance and high variability; we find several aspects of data set creation and evaluation which systematically inflate performance and obfuscate differences between languages. To improve generalizability and reliability of results, we propose new data sampling and evaluation strategies that better reflect likely use-cases. Using these new strategies, we make new observations on the generalization abilities of current inflection systems.
AB - Morphological inflection is a popular task in sub-word NLP with both practical and cognitive applications. For years now, state-of-the-art systems have reported high, but also highly variable, performance across data sets and languages. We investigate the causes of this high performance and high variability; we find several aspects of data set creation and evaluation which systematically inflate performance and obfuscate differences between languages. To improve generalizability and reliability of results, we propose new data sampling and evaluation strategies that better reflect likely use-cases. Using these new strategies, we make new observations on the generalization abilities of current inflection systems.
UR - https://www.scopus.com/pages/publications/85174388471
U2 - 10.18653/v1/2023.acl-long.335
DO - 10.18653/v1/2023.acl-long.335
M3 - Conference contribution
AN - SCOPUS:85174388471
T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics
SP - 6082
EP - 6101
BT - Long Papers
PB - Association for Computational Linguistics (ACL)
Y2 - 9 July 2023 through 14 July 2023
ER -