CFP last date
20 August 2024
Call for Paper
September Edition
IJCA solicits high quality original research papers for the upcoming September edition of the journal. The last date of research paper submission is 20 August 2024

Submit your paper
Know more
Reseach Article

Algorithm and Approaches to Handle Big Data

Published on May 2014 by Uzma Shafaque, Parag D. Thakare
National Level Technical Conference X-PLORE 2014
Foundation of Computer Science USA
XPLORE2014 - Number 1
May 2014
Authors: Uzma Shafaque, Parag D. Thakare

Uzma Shafaque, Parag D. Thakare . Algorithm and Approaches to Handle Big Data. National Level Technical Conference X-PLORE 2014. XPLORE2014, 1 (May 2014), 18-22.

author = { Uzma Shafaque, Parag D. Thakare },
title = { Algorithm and Approaches to Handle Big Data },
journal = { National Level Technical Conference X-PLORE 2014 },
issue_date = { May 2014 },
volume = { XPLORE2014 },
number = { 1 },
month = { May },
year = { 2014 },
issn = 0975-8887,
pages = { 18-22 },
numpages = 5,
url = { /proceedings/xplore2014/number1/16167-1417/ },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
%0 Proceeding Article
%1 National Level Technical Conference X-PLORE 2014
%A Uzma Shafaque
%A Parag D. Thakare
%T Algorithm and Approaches to Handle Big Data
%J National Level Technical Conference X-PLORE 2014
%@ 0975-8887
%N 1
%P 18-22
%D 2014
%I International Journal of Computer Applications

Environment of Big Data produces a large amount of data, in which it need to be analyzed and patterns have to be extracted, to gain knowledge. In this era of big data, with boom of data both structured data and unstructured data, in different field such as Engineering, Genomics, Biology, Meteorology, Environmental research and many more, it has become difficult to manage, process and analyze patterns using architectures and databases that are traditional. So, we should understand a proper architecture to gain knowledge about the Big Data. In this paper a review of various algorithms necessary for handling such large data set is given. These algorithms give us various methods implemented to handle Big Data.

  1. F. Michel, "How Many Photos Are Uploaded to Flickr Every Day and Month?"http://www. flickr. com/photos/franckmichel/6855169886/, 2012.
  2. "IBM What Is Big Data: Bring Big Data to the Enterprise," http://www-01. ibm. com/software/data/bigdata/, IBM, 2012.
  3. Feifei Li, Suman Nath "Scalable data summarization on big data", Distributed and Parallel DatabasesAn International Journal,15 February 2014.
  4. United Nations Global Pulse, 2012, Big Data for Development:Challenges& Opportunities, May 2012
  5. Office of Science and Technology Policy | Executive Office of the President, 2012, Fact Sheet: Big Data across the Federal Government, March 29??2012??www. WhiteHouse. gov/OSTP
  6. Office of Science and Technology Policy | Executive Office of the President, 2012, Obama Administration Unveils ??Big Data?? Initiative:Announces $200 Million in New R&D Investments, March 29??2012?? www. WhiteHouse. gov/OSTP
  7. McKinsey Global Institute, 2011, Big Data: the Next Frontier for Innovation, Competition, and Productivity, May 2011
  8. Rajaraman A, Ullman J D??Mining of Massive Datasets, Cambridge University Press, 2011
  9. EdmonBegoli, James Horey, "Design Principles for Effective Knowledge Discovery from Big Data", Joint Working Conference on Software Architecture & 6th European Conference on Software Architecture, 2012
  10. IvankaValova, Monique Noirhomme, "Processing Of Large Data Sets: Evolution, Opportunities And Challenges", Proceedings of PCaPAC08
  11. NehaSaxena, NiketBhargava, UrmilaMahor, Nitin Dixit, "An Efficient Technique on Cluster Based Master Slave Architecture Design", Fourth International Conference on Computational Intelligence and Communication Networks, 2012
  12. R. Caruana and A. Niculescu-Mizil, An Empirical Comparison of Supervised Learning Algorithms," in Proceedings of the 23rd international conference on Machine learning, ICML '06, (New York, NY, USA), pp. 161{168, ACM, 2006.
  13. R. Caruana, N. Karampatziakis, and A. Yessenalina, An Empirical Evaluation of Supervised Learning in High Dimensions," in Proceedings of the 25th international
  14. Mr. D. V. Patil, Prof. Dr. R. S. Bichkar, "A Hybrid Evolutionary Approach To Construct Optimal Decision Trees with Large Data Sets", IEEE, 2006
  15. Guillermo Sinchez-Diaz , Jose Ruiz-Shulcloper, "A Clustering Method for Very Large Mixed Data Sets", IEEE, 2001
  16. Mehmet Koyuturk, AnanthGrama, and NarenRamakrishnan, "Compression, Clustering, and Pattern Discovery in very High-Dimensional Discrete-Attribute Data Sets", IEEE Transactions On Knowledge And Data Engineering, April 2005, Vol. 17, No. 4
  17. Emily Namey, Greg Guest, Lucy Thairu, Laura Johnson, "Data Reduction Techniques for Large Qualitative Data Sets", 2007
  18. Moshe Looks, Andrew Levine, G. Adam Covington, Ronald P. Loui, John W. Lockwood, Young H. Cho, "Streaming Hierarchical Clustering for Concept Mining", IEEE, 2007
  19. Yen-ling Lu, chin-shyurngfahn, "Hierarchical Artificial Neural Networks For Recognizing High Similar Large Data Sets. ", Proceedings of the Sixth International Conference on Machine Learning and Cybernetics, August 2007
  20. Archana Singh, MeghaChaudhary, Dr (Prof. ) Ajay Rana, GauravDubey, "Online Mining of data to Generate Association Rule Mining in Large Databases", International Conference on Recent Trends in Information Systems, 2011
  21. David N. Reshef et al. ,"Detecting Novel Associations in Large Data Sets", Science AAAS, 2011, Science 334
  22. Shuliang Wang, WenyanGan, Deyi Li, Deren Li "Data Field For Hierarchical Clustering", International Journal of Data Warehousing and Mining, Dec. 2011
  23. Tatiana V. Karpinets, ByungH. Park, Edward C. Uberbacher, "Analyzing large biological datasets with association network", Nucleic Acids Research, 2012
  24. M. Vijayalakshmi, M. Renuka Devi, "A Survey Of Different Issues Of Different Clustering Algorithms Used In Large Data Sets", International Journal Of Advanced Research In Computer Science And Software Engineering, March 2012
  25. Xindong Wu, XingquanZhu,Gong-Qing Wu, and Wei Ding, "Data Mining with Big Data," IEEE Transactions On Knowledge And Data Engineering, Vol. 26, No. 1, January 2014.
Index Terms

Computer Science
Information Sciences


Big Data Data Mining Map-reduce Crowdsourcing Algorithm.