Call for Paper - March 2023 Edition
IJCA solicits original research papers for the March 2023 Edition. Last date of manuscript submission is February 20, 2023. Read More

Estimating Page Importance based on Page Accessing Frequency

International Journal of Computer Applications
© 2014 by IJCA Journal
Volume 86 - Number 5
Year of Publication: 2014
Komal Sachdeva
Ashutosh Dixit

Komal Sachdeva and Ashutosh Dixit. Article: Estimating Page Importance based on Page Accessing Frequency. International Journal of Computer Applications 86(5):1-6, January 2014. Full text available. BibTeX

	author = {Komal Sachdeva and Ashutosh Dixit},
	title = {Article: Estimating Page Importance based on Page Accessing Frequency},
	journal = {International Journal of Computer Applications},
	year = {2014},
	volume = {86},
	number = {5},
	pages = {1-6},
	month = {January},
	note = {Full text available}


With the vast growth of the Internet, many web pages are available online. Search engines use a component called as web crawlers for collecting these web pages from the web for storage and indexing. Many web pages are autonomous and are updated independent of the users. . As the web pages are updated autonomously; users do not come to know of how often the sources change. An incremental crawler visits the web repeatedly after a specific interval of time for the updation of its collection. Users are benefited by knowing the page importance based upon the page accessing frequency. This paper finds out the page importance based on page accessing frequency and also architecture for the same is also proposed.


  • Sakshi Goel, Anjana, Akhil Kaushik, Kirtika Goel, "A Novel Approach for Page Rank in Incremental Crawler", IJCST Vol. 3, Issue 1, Jan. - March 2012.
  • Niraj Singhal, Ashutosh Dixit, Dr. A. K. Sharma, "Design of a Priority Based Frequency Regulated Incremental Crawler", 2010 International Journal of Computer Applications (0975 – 8887) Volume 1 – No. 1.
  • Arvind Kumar, Km. Pooja, "An effective method for ranking of changed web pages in incremental crawler", International Journal of Computer Applications (0975 – 8887) Volume 8– No. 7, October 2010.
  • Rosy Madaan, Ashutosh Dixit, A. K. Sharma, Komal Kumar Bhatia, "A Framework for Incremental Hidden Web Crawler", International Journal of Computer Science and Engineering (IJCSNE), Vol. 02, No. 03, 2010.
  • Ravita Chahar, Komal Hooda, Annu Dhankhar, "Management of Volatile Information In Incremental Web Crawler", IJCSI International Journal of Computer Science Issues, Vol. 4, No. 1, 2009(ISSN (Online): 1694-0784, ISSN (Print): 1694-0814).
  • Ashutosh Dixit, Harish Kumar and A. K Sharma, "Self Adjusting Refresh Time Based Architecture For Incremental Web Crawler", International Journal of Computer Science and Network Security (IJCSNS), Vol 8, No12, Dec 2008.
  • M. P. S. Bhatia, Divya Gupta, "Discussion on Web Crawlers of Search Engine". Proceedings of 2nd National Conference on Challenges & Opportunities in Information Technology (COIT-2008) RIMT-IET, Mandi Gobindgarh. March 29, 2008.
  • Cho, J. and Roy, "Impact of search engines on page popularity". In Proc. 13th International World Wide Web Conference, 2004.
  • Arasu, J. Cho, H. Garcia-Molina, A. Paepcke, S. Raghavan, "Searching the Web", ACM Transactions on Internet Technology, Vol. 1, Num. 1, August 2001, pp. 2-43.
  • Mark Najork, Allan Heydon, "High- Performance Web Crawling", September 2001.
  • B. Mobasher, H. Dai, T. Luo, and M. Nakagawa. Effective personalization based on association rule discovery from web usage data. In Proceedings of the 3rd ACM Workhop on Web Information and Data Management, pages 9–15, November 2001. Atlanta, USA.
  • Arvind Arasu, Junghoo Cho, Hector Garcia-Molina, Andreas Paepcke, and Sriram Raghavan, "Searching the Web", ACM Transactions on Internet Technology (TOIT), 1(1):2–43, August 2001.
  • Junghoo Cho and Hector Garcia-Molina, "Estimating frequency of change", 2000, Submitted to VLDB 2000, Research track.
  • Junghoo Cho and Hector Garcia-Molina. 2000a. "The evolution of the web and implications for an incremental crawler". , In Proceedings of the 26th International Conference on Very Large Databases.
  • Brian E. Brewington and George Cybenko. "How dynamic is the web. " In Proceedings of the Ninth International World-Wide Web Conference, Amsterdam, Netherlands, May 2000.
  • Henzinger M. R. Link analysis in web information retrieval. IEEE Data Engineering Bulletin, 23(3):3-8, September 2000.
  • Jenny Edwards, Kevin McCurley, John Tomlin, "An Adaptive Model for Optimizing Performance of an Incremental Web Crawler".
  • Brin, Sergey and Page Lawrence, "The anatomy of a large-scale hypertextual Web search engine". Computer Networks and ISDN Systems, April 1998.
  • Mike, Burner, "Crawling towards Eternity : Building an archive of the World Wide Web", Web Techniques Magazine, 2(5), May 1997.