CFP last date
22 April 2024
Reseach Article

Refreshing Datawarehouse in Near Real-Time

by Tanvi Jain, Rajasree S, Shivani Saluja
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 46 - Number 18
Year of Publication: 2012
Authors: Tanvi Jain, Rajasree S, Shivani Saluja
10.5120/7042-9482

Tanvi Jain, Rajasree S, Shivani Saluja . Refreshing Datawarehouse in Near Real-Time. International Journal of Computer Applications. 46, 18 ( May 2012), 24-29. DOI=10.5120/7042-9482

@article{ 10.5120/7042-9482,
author = { Tanvi Jain, Rajasree S, Shivani Saluja },
title = { Refreshing Datawarehouse in Near Real-Time },
journal = { International Journal of Computer Applications },
issue_date = { May 2012 },
volume = { 46 },
number = { 18 },
month = { May },
year = { 2012 },
issn = { 0975-8887 },
pages = { 24-29 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume46/number18/7042-9482/ },
doi = { 10.5120/7042-9482 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T20:40:06.007841+05:30
%A Tanvi Jain
%A Rajasree S
%A Shivani Saluja
%T Refreshing Datawarehouse in Near Real-Time
%J International Journal of Computer Applications
%@ 0975-8887
%V 46
%N 18
%P 24-29
%D 2012
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Data warehousing technology has made a huge impact in the world of business; it helps to turn data into information that helps analysts to make strategic decisions. Currently most data warehouse approaches employ static refresh mechanisms. But for various business requirements this is not an appropriate solution. Some critical data need to be refreshed in real time. We propose an approach to identify critical data by considering two factors, namely: a) impact from one update, b) number of records affected. The identified critical data will be stored in the temporary tables, these temporary tables will be refreshed in real time and remaining data will be refreshed in conventional way

References
  1. Youchan Zhu, Lei An, Shuangxi Liu, "Data Updating and Query in Real-time Data Warehouse System", International Conference on Computer Science and Software Engineering, 2008, pp. 1295-1297
  2. Li Chen and Wenny Rahayu,David Taniar, "Towards Near Real-Time Data Warehousing", 24th IEEE International Conference on Advanced Information Networking and Applications, 2010, pp. 1150-1157
  3. JinGang Shi, YuBin Bao, FangLing Leng, Ge Yu, "Study on Log-Based Change Data Capture and Handling Mechanism in Real-Time Data Warehouse", International Conference on Computer Science and Software Engineering, 2008, pp. 478-481
  4. Dr. Muhammad Younus Javed, Asim Nawaz, "Data Load Distribution by Semi Real Time Data Warehouse", Second International Conference on Computer and Network Technology, 2010, pp. 556-560
  5. Paul Raj Poonia, "Fundamentals of Data Warehousing", John Wiley & Sons, 2003.
  6. Lukasz Golab, Theodore Johnson, and Vladislav Shkapenyuk, "Scheduling Updates in a Real-Time Stream Warehouse", IEEE International Conference on Data Engineering, 2009, pp. 1207-1210
  7. Kamber and Han, "Data Mining Concepts and Techniques", Hartcourt India P. Ltd. , 2001
  8. Xiaoliang Li, Fang Deng, Wensheng Li, "The Research and Application of an ETL Model Based on Task", The 1st International Conference on Information Science and Engineering, 2009, pp. 1006-1010
  9. Li Jian, Xu Bihua, "ETL Tool Research and Implementation Based on Drilling Data Warehouse", Seventh International Conference on Fuzzy Systems and Knowledge Discovery, 2010, pp. 2567-2569
  10. Michael J. Donahoo, Gregory D. Speegle,"SQL practical guide for developers", Elsevier Inc. , 2005
  11. Darshan M. Tank, Amit Ganatra, Y P Kosta, C K. Bhensdadia, "Speeding ETL Processing in Data Warehouses Using High-Performance Joins For Changed Data Capture (CDC)", International Conference on Advances in Recent Technologies in Communication and Computing, 2010, pp. 365-368
  12. Ricardo Jorge Santos, Jorge Bernardino, "Real-Time Data Warehouse Loading Methodology", IDEAS'08, Coimbra, Portugal Editor: Bipin C. DESAI, September 10–12, 2008, pp. 49-58
  13. Oracle Xi Reference Manual
  14. Sam Anahony, "Data Warehousing in the real world: A practical guide for building decision support systems", John Wiley, 2004
  15. W. H. Inmon, "Building the operational data store", 2nd Ed. , John Wiley, 1999.
Index Terms

Computer Science
Information Sciences

Keywords

Near Real-time Data Warehouse Change Data Capture (cdc) Extract Transform And Load (etl)