Call for Paper - April 2021 Edition
IJCA solicits original research papers for the April 2021 Edition. Last date of manuscript submission is March 22, 2021. Read More

Bad Data Detection and Data Filtering in Power System

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Year of Publication: 2018
Dhaval Bhatti, Anuradha Deshpande

Dhaval Bhatti and Anuradha Deshpande. Bad Data Detection and Data Filtering in Power System. International Journal of Computer Applications 182(30):36-39, December 2018. BibTeX

	author = {Dhaval Bhatti and Anuradha Deshpande},
	title = {Bad Data Detection and Data Filtering in Power System},
	journal = {International Journal of Computer Applications},
	issue_date = {December 2018},
	volume = {182},
	number = {30},
	month = {Dec},
	year = {2018},
	issn = {0975-8887},
	pages = {36-39},
	numpages = {4},
	url = {},
	doi = {10.5120/ijca2018918263},
	publisher = {Foundation of Computer Science (FCS), NY, USA},
	address = {New York, USA}


With increase in advanced metering infrastructure and sensor systems there is increase in data collection. It is hard to handle a large amount of data and assure the quality of data. Good quality of data is essential in power system before taking decision. So data must be cleaned and filtered before operator takes any decision from the data. Otherwise it will cause hazardous condition if poor quality of data affects decision making without knowledge of operator. Bad Data detection and data cleaning is helpful to get over this risk. With use of MATLAB Bad Data can be easily detected. Bad Data can be also removed and Data filtering as well as Data smoothing is also possible. Data smoothing is necessary for some application ex. Load forecasting in power system. Here it is obtained by using Statistical techniques such as OWA (Optimally Weighted Average) and MA (Moving Average).


  1. Hossein Akhavan-Hejazi, Hamed Mohsenian-Rad “Power systems big data analytics: An assessment of paradigm shift barriers and prospects”, Energy Reports, Volume 4, Pages 91-100, November 2018.
  2. N. Yu and S. Shah and R. Johnson and R. Sherick and M. Hong and K. Loparo “Big data analytics in power distribution systems” in IEEE Power Energy Society Innovative Smart Grid Technologies Conference (ISGT), Vol.0, No.0, pp.1-5, Feb2015.
  3. V. Hodge and J. Austin, “A survey of outlier detection methodologies”, Artificial intelligence review, vol. 22, no. 2, pp. 85–126, 2004.
  4. J. Peppanen, X. Zhang, S. Grijalva, and M. J. Reno, “Handling bad or missing smart meter data through advanced data imputation,” in IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT), 2016, pp. 1–5.
  5. L. J., T. H., and Y. M., “Real-time anomaly detection for very short term load forecasting,” Journal of Modern Power Systems and Clean Energy, vol. 6, no. 2, pp. 235–243, 2018.
  6. H. Huang, Q. Yan, Y. Zhao, W. Lu, Z. Liu, and Z. Li, “False data separation for data security in smart grids,” Knowledge and Information Systems, pp. 1–20, 2017.
  7. Chongqing Kang, Yi Wang, Yusheng Xue, Gang Mu, and Ruijin Liao “Big Data Analytics in China’s Electric Power Industry” in IEEE Power and Energy Magazine, Volume 16, Pages  54 - 65, April 2018.
  8. A.Al- Wakeel, J Wu, and N Jenkins," K means based load estimation of domestic smart meter measurements." Applied Energy, Vol 194,pp 333-342, 2017
  9. Yi Wang, Qixin Chen, Tao Hong, Chongqing Kang“Review of Smart Meter Data Analytics: Applications, Methodologies, and Challenges” in IEEE Transactions on Smart Grid(Early Access) Pages 1-1, March 2018.
  10. Mingyang Sun “Big Data Analytics in Power System”, Imperial Collage of London, November 2016.
  11. Fintan McLoughlin, Aidan Duffy, Michael Conlon “A clustering approach to domestic electricity load profile characterization using smart metering data”, Energy Reports, Volume 141, Pages 190-199, 1 March 2015.


Big Data Analytic Advanced Metering Infrastructure, Load Forecasting, Smart Meter.