The week's pick
Reseach Article
An Efficient Web Content Extraction from Large Collection of Web Documents using Mining Methods
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 69 - Number 7 |
| Year of Publication: 2013 |
| Authors: S.mahesha, M. Giri, M.s Shashidhara |
10.5120/11852-7614
|
S.mahesha, M. Giri, M.s Shashidhara . An Efficient Web Content Extraction from Large Collection of Web Documents using Mining Methods. International Journal of Computer Applications. 69, 7 ( May 2013), 8-13. DOI=10.5120/11852-7614
Abstract
Web mining is a one class of data mining. Web Mining is a variation of data mining that distills untapped source of abundantly available free textual information. The need and importance of web mining is growing along with the massive volumes of data generated in web day-to-day life. Web data Clustering is the organization of a collection of web documents into clusters based on similarity. A good clustering algorithm should have high intra-cluster similarity and low inter-cluster similarity. The process of grouping similar documents for versatile applications has put the eye of researchers in this area. In general, web data always arrives in a continuous, multiple, rapid and time varying flow. The Researchers in web mining proposed many methods to extract web contents, but they are fail to handle dynamic data. Web content extraction algorithms are important to extract useful contents from web sources. We propose a new method for web content extraction. It consist of four phases: Web document selection phase, web cube creation phase, web document preprocessing phase, and presentation phase. In the first phase list of web documents are selected for mining, second phase documents are used to create web cube, third phase documents are preprocessed, in the final phase results are presented to users. The experimental results of proposed system are compared with existing methods, Performance of proposed system is better than previous methods.
References
- Magdalini Eirinaki and Michalis Vazirgiannis. Web mining for web personalization. ACM Transactions on Internet Technology, 3(1):1-27, 2003.
- Dimitrios Pierrakos, Georgios Paliouras, Christos Papatheodorou, and Constantine D. Spyropoulos. Web usage mining as a tool for personalization: A survey. User Modeling and User-Adapted Interaction, 6(2):311-372, 2003.
- Zhen Zhang. Large-scale deep web integration: Exploring and querying structured data on the deep web, 2006.
- Ryan Levering and Michal Cutler. The portrait of a common HTML web page. In 2006 ACM symposium on Document engineering, pages 198-204, 2006.
- Michael K. Bergman. The deep web: Surfacing hidden value. The Journal of Electronic Publishing, 7(1), 2001.
- King-Ip Lin and Hui Chen. Automatic information discovery from the 'invisible web'. In 2002 International Conference on Information Technology: Coding and Computing, page 332, 2002.
- Dirk Lewandowski and Philipp Mayr. Exploring the academic invisible web. Library Hi Tech, 24(4):529-539, 2006.
- Bin He and Kevin Chen-Chuan Chang. Statistical schema matching across web query interfaces. In 2003 ACM SIGMOD International Conference on Management of Data, 2003.
- Witold Abramowicz, Dominik Flejter, Tomasz Kaczmarek, Monika Starzecka, and Adam Walczak. Semantically enhanced deep web. In 3rd International AST Workshop, pages 675-680, 2008.
- Dominik Flejter and Tomasz Kaczmarek. Wybrane aspekty integracji informacji z g l,ebokiego Internetu, pages 97-110. Wydaw. AE, 2007.
- Yan LI, Boqin FENG and Qinjiao MAO, "Research on Path Completion Technique In Web Usage Mining", IEEE International Symposium On Computer Science and Computational Technology, pp. 554-559, 2008.
- JING Chang-bin and Chen Li, " Web Log Data Preprocessing Based On Collaborative Filtering ", IEEE 2nd International Workshop On Education Technology and Computer Science, pp. 118-121, 2010.
- Huiping Peng, "Discovery of Interesting Association Rules Based On Web Usage Mining", IEEE Conference, pp. 272-275, 2010.
- Tasawar Hussain, Dr. Sohail Asghar and Nayyer Masood, "Hierarchical Sessionization at Preprocessing Level of WUM Based on Swarm Intelligence ", 6th International Conference on Emerging Technologies (ICET) IEEE, pp. 21-26, 2010.
- Doru Tanasa and Brigitte Trousse,"Advanced Data Preprocessing for Inter-sites Web Usage Mining ", Published by the IEEE Computer Society, pp. 59-65, March/April 2004.
- Ling Zheng, Hui Gui and Feng Li, "Optimized Data Preprocessing Technology For Web Log Mining", IEEE International Conference On Computer Design and Applications( ICCDA ), pp. VI-19-VI-21,2010.
- Nahm, U. Y. , Bilenko, M. and Mooney R. J. "Two Approaches to Handling Noisy Variation in Text Mining". ICML-2002 Workshop on Text Learning, 2002
- Shian-Hua Lin and Jan-Ming Ho. Discovering Informative Content Blocks from Web Documents, KDD-02, 2002.
Index Terms
Keywords