vix.ing · top · new · best · stats · spec

Unsupervised Named Entity Disambiguation for Low Resource Domains

2024/12/13 by D. V. Datta, Datta, Debarghya, Soumajit Pramanik +1
Decision Sciences · Computer Science · #Data Quality and Management #Topic Modeling #Natural Language Processing Techniques

paper · pdf · doi:10.48550/arxiv.2412.10054

Abstract

In the ever-evolving landscape of natural language processing and information\nretrieval, the need for robust and domain-specific entity linking algorithms\nhas become increasingly apparent. It is crucial in a considerable number of\nfields such as humanities, technical writing and biomedical sciences to enrich\ntexts with semantics and discover more knowledge. The use of Named Entity\nDisambiguation (NED) in such domains requires handling noisy texts, low\nresource settings and domain-specific KBs. Existing approaches are mostly\ninappropriate for such scenarios, as they either depend on training data or are\nnot flexible enough to work with domain-specific KBs. Thus in this work, we\npresent an unsupervised approach leveraging the concept of Group Steiner Trees\n(GST), which can identify the most relevant candidates for entity\ndisambiguation using the contextual similarities across candidate entities for\nall the mentions present in a document. We outperform the state-of-the-art\nunsupervised methods by more than 40 % (in avg.) in terms of Precision@1 across\nvarious domain-specific datasets.\n

Related