Semantic Answer Type Prediction using BERT: IAI at the ISWC SMART Task 2020
Chapter
Published version
Permanent lenke
https://hdl.handle.net/11250/3050602Utgivelsesdato
2020Metadata
Vis full innførselSamlinger
Originalversjon
Setty, V., Balog, K. (2020). Semantic Answer Type Prediction using BERT: IAI at the ISWC SMART Task 2020. I: Proceedings of the SeMantic AnsweR Type prediction task (SMART) at ISWC 2020 Semantic Web Challenge co-located with the 19th. International, Semantic Web Conference {(ISWC} 2020), Virtual Conference, November, 5th, 2020. : CEUR Workshop Proceedings, s. 10-18Sammendrag
This paper summarizes our participation in the SMART Task of the ISWC 2020 Challenge. A particular question we are interested in answering is how well neural methods, and specifically transformer models, such as BERT, perform on the answer type prediction task compared to traditional approaches. Our main finding is that coarse-grained answer types can be identified effectively with standard text classification methods, with over 95% accuracy, and BERT can bring only marginal improvements. For fine-grained type detection, on the other hand, BERT clearly outperforms previous retrieval-based approaches.