CFP last date
22 April 2024
Reseach Article

GeoProcessing Workflow Models for Distributed Processing Frameworks

by Shruti Thakker, Jhummarwala Abdul, M. B. Potdar
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 113 - Number 1
Year of Publication: 2015
Authors: Shruti Thakker, Jhummarwala Abdul, M. B. Potdar
10.5120/19794-1574

Shruti Thakker, Jhummarwala Abdul, M. B. Potdar . GeoProcessing Workflow Models for Distributed Processing Frameworks. International Journal of Computer Applications. 113, 1 ( March 2015), 33-38. DOI=10.5120/19794-1574

@article{ 10.5120/19794-1574,
author = { Shruti Thakker, Jhummarwala Abdul, M. B. Potdar },
title = { GeoProcessing Workflow Models for Distributed Processing Frameworks },
journal = { International Journal of Computer Applications },
issue_date = { March 2015 },
volume = { 113 },
number = { 1 },
month = { March },
year = { 2015 },
issn = { 0975-8887 },
pages = { 33-38 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume113/number1/19794-1574/ },
doi = { 10.5120/19794-1574 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T22:49:52.299804+05:30
%A Shruti Thakker
%A Jhummarwala Abdul
%A M. B. Potdar
%T GeoProcessing Workflow Models for Distributed Processing Frameworks
%J International Journal of Computer Applications
%@ 0975-8887
%V 113
%N 1
%P 33-38
%D 2015
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Geographic Information Systems (GIS) platforms are used to implement and deal with the massive spatial data, especially image data. Therefore, these platforms require high storage capacity and high computational power to process them. This paper aims of processing of Geodata using Distributed processing Frameworks. Large volume of Geodata cannot be processed using desktop GIS tools such as QGIS, ArcGIS, GRASS, OpenJUMP etc. Therefore, to handle and process on these types of large data, use of Hadoop Distributed processing framework needs to be deployed. GeoProcessing is a GIS operation used to manipulate spatial data. It is one of the original proposal in GIS development. Almost every GIS application is represented by a GeoProcessing Workflow. This paper explains the GeoProcessing Workflow for processing of image data. Also explains Hadoop Distributed File System (HDFS), MapReduce Programming Model and Yet Another Resource Negotiator (YARN) architecture, useful in large spatial data handling and analysis at fast rate.

References
  1. Siddiqui, S. T. ; Alam, M. S. ; Bokhari, M. U. , "Software Tools Required to Develop GIS Applications: An Overview," Advanced Computing & Communication Technologies (ACCT), 2012 Second International Conference on , vol. , no. , pp. 51,56, 7-8 Jan. 2012.
  2. Eldawy, A. , Li, Y. , Mokbel, M. F. , & Janardan, R. "CG_Hadoop: computational geometry in MapReduce. " In Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 284-293, ACM. November 2013.
  3. Central Africa Regional Program for the Environment: http://carpe. umd. edu/geospatial/satellite_imagery_resources. php
  4. Dean, J. , & Ghemawat, S. "MapReduce: simplified data processing on large clusters. " Communications of the ACM, 51, vol. 1, 107-113. 2013.
  5. The Apache Software Foundation: http://hadoop. apache. org/
  6. Kalavri, V. ; Vlassov, V. , "MapReduce: Limitations, Optimizations and Open Issues," Trust, Security and Privacy in Computing and Communications (TrustCom), 2013 12th IEEE International Conference on , vol. , no. , pp. 1031,1038, 16-18 July 2013.
  7. Hadoop YARN: http://hortonworks. com/hadoop/yarn/
  8. Hadoop at Yahoo!: https://developer. yahoo. com/hadoop/
  9. Wei Xiang Goh; Kian-Lee Tan, "Elastic MapReduce Execution," Cluster, Cloud and Grid Computing (CCGrid), 2014 14th IEEE/ACM International Symposium on , vol. , no. , pp. 216,225, 26-29 May 2014.
  10. Schaeffer, B. , Baranski, B. , Foerster, T. , & Brauner, J. " A service-oriented framework for real-time and distributed geoprocessing" ,In Geospatial Free and Open Source Software in the 21st Century , pp. 3-20, Springer Berlin Heidelberg. 2012.
  11. Khan, F. A. , & Brezany, P. "Provenance Support for Data-Intensive Scientific Workflows. " In Grid and Cloud Database Management , pp. 215-234, Springer Berlin Heidelberg. 2011.
  12. Pallickara, S. L. , Malensek, M. , & Pallickara, S. (2011). "On the Processing of Extreme Scale Datasets in the Geosciences. " In Handbook of Data Intensive Computing , pp. 521-537, Springer New York. 2011.
  13. Tungkasthan, A. ; Premchaiswadi, W. , "A parallel processing framework using MapReduce for content-based image retrieval," ICT and Knowledge Engineering (ICT&KE), 2013 11th International Conference on , vol. , no. , pp. 1,6, 20-22 Nov. 2013.
  14. ISO Standards : www. iso. org/iso/catalouge_detail. htm
  15. OGC Standards : www. opengeospatial. org/standards
Index Terms

Computer Science
Information Sciences

Keywords

GIS Geoproceeing Workflow Distributed System Hadoop YARN MapReduce Classic.