2019/04/10 by Mostafa Mirzaie, Mirzaie, Mostafa, Behshid Behkamal +3 · 1 citation
Decision Sciences · Business, Management and Accounting · Computer Science · #Data Quality and Management #Big Data and Business Intelligence #Data Mining Algorithms and Applications
paper · pdf · doi:10.48550/arxiv.1904.05353
One of the most significant problems of Big Data is to extract knowledge\nthrough the huge amount of data. The usefulness of the extracted information\ndepends strongly on data quality. In addition to the importance, data quality\nhas recently been taken into consideration by the big data community and there\nis not any comprehensive review conducted in this area. Therefore, the purpose\nof this study is to review and present the state of the art on the quality of\nbig data research through a hierarchical framework. The dimensions of the\nproposed framework cover various aspects in the quality assessment of Big Data\nincluding 1) the processing types of big data, i.e. stream, batch, and hybrid,\n2) the main task, and 3) the method used to conduct the task. We compare and\ncritically review all of the studies reported during the last ten years through\nour proposed framework to identify which of the available data quality\nassessment methods have been successfully adopted by the big data community.\nFinally, we provide a critical discussion on the limitations of existing\nmethods and offer suggestions on potential valuable research directions that\ncan be taken in future research in this domain.\n