CFP last date
20 June 2024
Reseach Article

Trend Analysis based on Access Pattern over Web Logs using Hadoop

by Jalpa Mehta, Amir Ansari, Aseem Girkar, Ayesha Khanna, Ankit Nagda
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 115 - Number 8
Year of Publication: 2015
Authors: Jalpa Mehta, Amir Ansari, Aseem Girkar, Ayesha Khanna, Ankit Nagda
10.5120/20175-2376

Jalpa Mehta, Amir Ansari, Aseem Girkar, Ayesha Khanna, Ankit Nagda . Trend Analysis based on Access Pattern over Web Logs using Hadoop. International Journal of Computer Applications. 115, 8 ( April 2015), 34-37. DOI=10.5120/20175-2376

@article{ 10.5120/20175-2376,
author = { Jalpa Mehta, Amir Ansari, Aseem Girkar, Ayesha Khanna, Ankit Nagda },
title = { Trend Analysis based on Access Pattern over Web Logs using Hadoop },
journal = { International Journal of Computer Applications },
issue_date = { April 2015 },
volume = { 115 },
number = { 8 },
month = { April },
year = { 2015 },
issn = { 0975-8887 },
pages = { 34-37 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume115/number8/20175-2376/ },
doi = { 10.5120/20175-2376 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T22:54:18.412474+05:30
%A Jalpa Mehta
%A Amir Ansari
%A Aseem Girkar
%A Ayesha Khanna
%A Ankit Nagda
%T Trend Analysis based on Access Pattern over Web Logs using Hadoop
%J International Journal of Computer Applications
%@ 0975-8887
%V 115
%N 8
%P 34-37
%D 2015
%I Foundation of Computer Science (FCS), NY, USA
Abstract

There is an invariable progress and extension of the World Wide Web which has resulted into the generation of log files having enormous magnitude of data. Log files incorporate traits of user behavior, therefore it is essential to analyze log data and acquire knowledge from it. Web mining techniques primarily focuses on deciphering and scrutinizing the navigational behavior of user form various aspects and ascertaining the hidden knowledge from these web logs. As log files over the web are outsized, storage becomes a constraint wherein effective techniques such as virtual database prove to be ineffectual for the same. Conversely, Hadoop offers a large scale distributed batch processing infrastructure that provides adequate data storage, distributive and analogous processing, isolation of process and fault tolerant on occurrences of data loss. This paper characterizes on the dominant approach for managing the large chunk of web log data using Hadoop MapReduce which reduces the response time for throughput generation, loads the log data effectively and ensures reliability. The primary focus of the paper is to construct log analysis system which depicts trends based on the users browsing mode using Hadoop MapReduce which facilitates handling of heterogeneous query execution on log file.

References
  1. Sayalee Narkhede and Tripti Baraskar, "hmr log analyzer: analyze web application logs over hadoop mapreduce", International Journal of UbiComp (IJU), Vol. 4, No. 3, July 2013
  2. Milind Bhandare, Prof. Kuntal Barua, Vikas Nagare, Dynaneshwar Ekhande, Rahul Pawar, " Generic Log Analyzer Using Hadoop Mapreduce Framework", International Journal of Emerging Technology and Advanced Engineering, Volume 3, Issue 9, September 2013
  3. Navin Kumar Tyagi, A. K. Solanki and Manoj Wadhwa, "Analysis of Server Log by Web Usage Mining for Website Improvement", IJCSI International Journal of Computer Science Issues, Vol. 7, Issue 4, No 8, July 2010
  4. L. K . Joshila Grace, V. Maheswari, Dhinaharan Nagamalai, "ANALYSIS OF WEB LOGS AND WEB USER IN WEB MINING", International Journal of Network Security & Its Applications (IJNSA), Vol. 3, No. 1, January 2011
  5. Praveen Kumar, Dr Vijay Singh Rathore, "Efficient Capabilities of Processing of Big Data using Hadoop Map Reduce", International Journal of Advanced Research in Computer and Communication Engineering Vol. 3, Issue 6, June 2014
  6. Anuja Pandit, Amruta Deshpande, Prajakta Karmarkar, "Log Mining Based on Hadoop's Map and Reduce Technique", International Journal on Computer Science and Engineering (IJCSE) Vol. 5 No. 04 Apr 2013
  7. Yahoo Hadoop's tutorial, https://developer. yahoo. com/ hadoop/tutorial/
Index Terms

Computer Science
Information Sciences

Keywords

Cloudera Hadoop MapReduce Log Files Web Mining MySql Database Hadoop Distributed File System Trend Analysis.