Call for Paper - January 2022 Edition
IJCA solicits original research papers for the January 2022 Edition. Last date of manuscript submission is December 20, 2021. Read More

FME Enabled ETL Processes for Spatial and Attribute Data Analysis

Print
PDF
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Year of Publication: 2017
Authors:
Farhad Alam, Sanjay Pachauri
10.5120/ijca2017914754

Farhad Alam and Sanjay Pachauri. FME Enabled ETL Processes for Spatial and Attribute Data Analysis. International Journal of Computer Applications 169(5):31-35, July 2017. BibTeX

@article{10.5120/ijca2017914754,
	author = {Farhad Alam and Sanjay Pachauri},
	title = {FME Enabled ETL Processes for Spatial and Attribute Data Analysis},
	journal = {International Journal of Computer Applications},
	issue_date = {July 2017},
	volume = {169},
	number = {5},
	month = {Jul},
	year = {2017},
	issn = {0975-8887},
	pages = {31-35},
	numpages = {5},
	url = {http://www.ijcaonline.org/archives/volume169/number5/27984-2017914754},
	doi = {10.5120/ijca2017914754},
	publisher = {Foundation of Computer Science (FCS), NY, USA},
	address = {New York, USA}
}

Abstract

ETL is a type of data integration that refers to the three steps (extract, transform, and load) used to blend data from multiple sources. It's often used to build a data warehouse. During this process, data is taken (extracted) from a source system, converted (transformed) into a format that can be analyzed, and stored (loaded) into a data warehouse or other system. FME has a rich data model designed implement ETL. FME provides tremendous transformation functionality, resulting in output that can be much greater than the sum of the inputs, and allowing data to be transformed from one type to another. The current paper uses FME workbench and implement the concept of ETL using a case study where a private firm wants to integrate attribute and spatial information regarding its employee, filter the unnecessary information and finally implement business query regarding Monthly Travelling Allowance. The results establish ETL and FEM as interdisciplinary technological domain and backbone of the data warehouse architecture.

References

  1. Jukic, N., 2006. Modeling strategies and alternatives for data warehousing projects. Communications of the ACM, 49(4), pp.83-88.
  2. Kimball, R. and Ross, M., 2011. The data warehouse toolkit: the complete guide to dimensional modeling. John Wiley & Sons.
  3. Cuzzocrea, A., Song, I.Y. and Davis, K.C., 2011, October. Analytics over large-scale multidimensional data: the big data revolution!. In Proceedings of the ACM 14th international workshop on Data Warehousing and OLAP (pp. 101-104). ACM.
  4. Eckerson, W. and White, C., 2003. Evaluating ETL and data integration platforms. Seattle: The DW Institute.
  5. Golfarelli, M., Rizzi, S. and Cella, I., 2004, November. Beyond data warehousing: what's next in business intelligence?. In Proceedings of the 7th ACM international workshop on Data warehousing and OLAP (pp. 1-6). ACM.
  6. Karakasidis, A., Vassiliadis, P. and Pitoura, E., 2005, June. ETL queues for active data warehousing. In Proceedings of the 2nd international workshop on Information quality in information systems (pp. 28-39). ACM.
  7. Jarke, M., Lenzerini, M., Vassiliou, Y., Vassiliadis, P., 2003. Fundamentals of Data Warehouses, second ed. Springer-Verlag.
  8. Suresh, S., Gautam, J.P., Pancha, G., DeRose, F.J. and Sankaran, M., Informatica Corporation, 2001. Method and architecture for automated optimization of ETL throughput in data warehousing applications. U.S. Patent 6,208,990.
  9. Berson, A., Smith, S.J., 1997. Data Warehousing, Data Mining, and OLAP. McGraw-Hill.
  10. Moss, L.T., 2005. Moving Your ETL Process into Primetime. (visited June 2005).
  11. Feature Manipulation Engine (FME): https://www.safe.com
  12. Microsoft Office Home: https://www.office.com
  13. Google Earth: http://earth.google.com
  14. KML OGC:www.opengeospatial.org/standards/ kml

Keywords

Extract, Transform, and Load (ETL), Feature Manipulation Engine (FME), Keyhole Markup Language (KML), Attribute.