In data mining applications, there are various kinds of missing values in experimental datasets. Nonsubstitution or inappropriate treatment of missing values has a high probability to cause a lot of warnings or errors. Besides, many classification algorithms are very sensitive to the missing values. Because of these, handling the missing values is an important phase in many classification or data mining task. This paper introduces traditional EM algorithm and disadvantage of the EM algorithm. This paper proposes a new method to implement the missing values based on EM algorithm, which uses Naive Bayesian to improve the accuracy. We conclude by classifying seeds dataset and vertebral columns dataset and comparing the results to those obtained by applying two other missing value handling methods: the traditional EM algorithm and the non-substitution method. The experimental results prove a stable algorithm for improving the data classification accuracy on large datasets, which contain a lot of missing values.
Keywords
Data mining
Data cleaning
Expectation Maximization Algorithm
Authors
M.Devaraj
N. Santhana Krishna
How to Cite this Article
M.Devaraj, N. Santhana Krishna (2017).
"MODIFING INCONSISTENT, NOISY DATA USING NB-EM ALGORITHM".
International Journal of Contemporary Research in Computer Science and Technology,
3(6), pp. 11-15.
