Entity Reconciliation in Big Data Sources: a Systematic Mapping Study

J.G. Enríquez , F.J. Domínguez-Mayo , M.J. Escalona , Margaret Ross, Geoff Staples

    Research output: Contribution to journalArticle

    Abstract

    The entity reconciliation (ER) problem aroused much interest as a research topic in today's Big Data era, full of big and open heterogeneous data sources. This problem poses when relevant information on a topic needs to be obtained using methods based on: (i) identifying records that represent the same real world entity, and (ii) identifying those records that are similar but do not correspond to the same real-world entity. ER is an operational intelligence process, whereby organizations can unify different and heterogeneous data sources in order to relate possible matches of non-obvious entities. Besides, the complexity that the heterogeneity of data sources involves, the large number of records and differences among languages, for instance, must be added. This paper describes a Systematic Mapping Study (SMS) of journal articles, conferences and workshops published from 2010 to 2017 to solve the problem described before, first trying to understand the state-of-the-art, and then identifying any gaps in current research. Eleven digital libraries were analyzed following a systematic, semiautomatic and rigorous process that has resulted in 61 primary studies. They represent a great variety of intelligent proposals that aim to solve ER. The conclusion obtained is that most of the research is based on the operational phase as opposed to the design phase, and most studies have been tested on real-world data sources, where a lot of them are heterogeneous, but just a few apply to industry. There is a clear trend in research techniques based on clustering/blocking and graphs, although the level of automation of the proposals is hardly ever mentioned in the research work.
    Original languageEnglish
    Pages (from-to)14-27
    JournalExpert Systems with Applications
    Volume80
    Issue number1
    DOIs
    Publication statusPublished - 10 Mar 2017

    Fingerprint Dive into the research topics of 'Entity Reconciliation in Big Data Sources: a Systematic Mapping Study'. Together they form a unique fingerprint.

  • Cite this

    Enríquez , J. G., Domínguez-Mayo , F. J., Escalona , M. J., Ross, M., & Staples, G. (2017). Entity Reconciliation in Big Data Sources: a Systematic Mapping Study. Expert Systems with Applications, 80(1), 14-27. https://doi.org/10.1016/j.eswa.2017.03.010