Re-Examining FactBank: Predicting the Author’s Presentation of Factuality

John Murzaku; Peter Zeng; Magdalena Markowska; Owen Rambow

Re-Examining FactBank: Predicting the Author’s Presentation of Factuality

John Murzaku
, Peter Zeng
, Magdalena Markowska
, Owen Rambow

Linguistics

Stony Brook University

Research output: Contribution to journal › Conference article › peer-review

8 Scopus citations

Abstract

We present a corrected version of a previous projection of the FactBank data set. Previously published results on FactBank are no longer valid. We perform experiments on FactBank using multiple training paradigms, data smoothing techniques, and polarity classifiers. We argue that f-measure is an important alternative evaluation metric for factuality. We provide new state-of-the-art results for four corpora including FactBank. We perform an error analysis on Factbank combined with two similar corpora.

Original language	English
Pages (from-to)	786-796
Number of pages	11
Journal	Proceedings - International Conference on Computational Linguistics, COLING
Volume	29
Issue number	1
State	Published - 2022
Event	29th International Conference on Computational Linguistics, COLING 2022 - Gyeongju, Korea, Republic of Duration: Oct 12 2022 → Oct 17 2022

Cite this

@article{794c75ece41e42cc9d9b8bed602c6710,

title = "Re-Examining FactBank: Predicting the Author{\textquoteright}s Presentation of Factuality",

abstract = "We present a corrected version of a previous projection of the FactBank data set. Previously published results on FactBank are no longer valid. We perform experiments on FactBank using multiple training paradigms, data smoothing techniques, and polarity classifiers. We argue that f-measure is an important alternative evaluation metric for factuality. We provide new state-of-the-art results for four corpora including FactBank. We perform an error analysis on Factbank combined with two similar corpora.",

author = "John Murzaku and Peter Zeng and Magdalena Markowska and Owen Rambow",

note = "Publisher Copyright: {\textcopyright} 2022 Proceedings - International Conference on Computational Linguistics, COLING. All rights reserved.; 29th International Conference on Computational Linguistics, COLING 2022 ; Conference date: 12-10-2022 Through 17-10-2022",

year = "2022",

language = "English",

volume = "29",

pages = "786--796",

journal = "Proceedings - International Conference on Computational Linguistics, COLING",

issn = "2951-2093",

number = "1",

}

TY - JOUR

T1 - Re-Examining FactBank

T2 - 29th International Conference on Computational Linguistics, COLING 2022

AU - Murzaku, John

AU - Zeng, Peter

AU - Markowska, Magdalena

AU - Rambow, Owen

PY - 2022

Y1 - 2022

N2 - We present a corrected version of a previous projection of the FactBank data set. Previously published results on FactBank are no longer valid. We perform experiments on FactBank using multiple training paradigms, data smoothing techniques, and polarity classifiers. We argue that f-measure is an important alternative evaluation metric for factuality. We provide new state-of-the-art results for four corpora including FactBank. We perform an error analysis on Factbank combined with two similar corpora.

AB - We present a corrected version of a previous projection of the FactBank data set. Previously published results on FactBank are no longer valid. We perform experiments on FactBank using multiple training paradigms, data smoothing techniques, and polarity classifiers. We argue that f-measure is an important alternative evaluation metric for factuality. We provide new state-of-the-art results for four corpora including FactBank. We perform an error analysis on Factbank combined with two similar corpora.

UR - https://www.scopus.com/pages/publications/85165760755

M3 - Conference article

AN - SCOPUS:85165760755

SN - 2951-2093

VL - 29

SP - 786

EP - 796

JO - Proceedings - International Conference on Computational Linguistics, COLING

JF - Proceedings - International Conference on Computational Linguistics, COLING

IS - 1

Y2 - 12 October 2022 through 17 October 2022

ER -

Re-Examining FactBank: Predicting the Author’s Presentation of Factuality

Abstract

Other files and links

Fingerprint

Cite this