Enrico Santus
2020
Are Word Embeddings Really a Bad Fit for the Estimation of Thematic Fit?
Emmanuele Chersoni
|
Ludovica Pannitto
|
Enrico Santus
|
Alessandro Lenci
|
Chu-Ren Huang
Proceedings of The 12th Language Resources and Evaluation Conference
While neural embeddings represent a popular choice for word representation in a wide variety of NLP tasks, their usage for thematic fit modeling has been limited, as they have been reported to lag behind syntax-based count models. In this paper, we propose a complete evaluation of count models and word embeddings on thematic fit estimation, by taking into account a larger number of parameters and verb roles and introducing also dependency-based embeddings in the comparison. Our results show a complex scenario, where a determinant factor for the performance seems to be the availability to the model of reliable syntactic information for building the distributional representations of the roles.
Distilling the Evidence to Augment Fact Verification Models
Beatrice Portelli
|
Jason Zhao
|
Tal Schuster
|
Giuseppe Serra
|
Enrico Santus
Proceedings of the Third Workshop on Fact Extraction and VERification (FEVER)
The alarming spread of fake news in social media, together with the impossibility of scaling manual fact verification, motivated the development of natural language processing techniques to automatically verify the veracity of claims. Most approaches perform a claim-evidence classification without providing any insights about why the claim is trustworthy or not. We propose, instead, a model-agnostic framework that consists of two modules: (1) a span extractor, which identifies the crucial information connecting claim and evidence; and (2) a classifier that combines claim, evidence, and the extracted spans to predict the veracity of the claim. We show that the spans are informative for the classifier, improving performance and robustness. Tested on several state-of-the-art models over the Fever dataset, the enhanced classifiers consistently achieve higher accuracy while also showing reduced sensitivity to artifacts in the claims.
Search
Co-authors
- Emmanuele Chersoni 1
- Ludovica Pannitto 1
- Alessandro Lenci 1
- Chu-Ren Huang 1
- Beatrice Portelli 1
- show all...