CFP last date
20 May 2024
Reseach Article

Recognition of Handwritten Flowcharts using Convolutional Neural Networks

by C. David Betancourt Montellano, C. Onder Francisco Campos Garcia, Roberto Oswaldo Cruz Leija
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 184 - Number 1
Year of Publication: 2022
Authors: C. David Betancourt Montellano, C. Onder Francisco Campos Garcia, Roberto Oswaldo Cruz Leija
10.5120/ijca2022921969

C. David Betancourt Montellano, C. Onder Francisco Campos Garcia, Roberto Oswaldo Cruz Leija . Recognition of Handwritten Flowcharts using Convolutional Neural Networks. International Journal of Computer Applications. 184, 1 ( Mar 2022), 37-41. DOI=10.5120/ijca2022921969

@article{ 10.5120/ijca2022921969,
author = { C. David Betancourt Montellano, C. Onder Francisco Campos Garcia, Roberto Oswaldo Cruz Leija },
title = { Recognition of Handwritten Flowcharts using Convolutional Neural Networks },
journal = { International Journal of Computer Applications },
issue_date = { Mar 2022 },
volume = { 184 },
number = { 1 },
month = { Mar },
year = { 2022 },
issn = { 0975-8887 },
pages = { 37-41 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume184/number1/32301-2022921969/ },
doi = { 10.5120/ijca2022921969 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-07T01:20:21.143985+05:30
%A C. David Betancourt Montellano
%A C. Onder Francisco Campos Garcia
%A Roberto Oswaldo Cruz Leija
%T Recognition of Handwritten Flowcharts using Convolutional Neural Networks
%J International Journal of Computer Applications
%@ 0975-8887
%V 184
%N 1
%P 37-41
%D 2022
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Currently, artificial vision is used in an endless number of tasks from domestic tasks to industrial and educational ones since with it those tasks can be streamlined because of having an automated process. This project explores the problem of handwritten information recovery, specifically the flowcharts used in the programming and designing of algorithms,approaching a solution with artificial vision, and proposes a pipeline able to recognize the elements of a handwritten flowchart using convolutional neural networks in order to generate code source in the C programming language equivalent to the recognized diagram, in addition the digitalized version of the flow diagram, thus automating the various tasks, having as a final result a file with .c extension with the source code, the compilation output and an image in .png format with the digitization of the diagram.

References
  1. O. CairóBattistutti, Metodología de la programación, 3rd ed. México, D.F.: Alfaomega, 1995, pp. 3, 4-8.
  2. W. Szwoch and M. Mucha, “Recognition of Hand Drawn Flowcharts” Advances in Intelligent Systems and Computing Image Processing and Communications Challenges 4, vol. 184, pp. 65–72, 2013.
  3. J. I. Herrera Camara, "Flow2Code: from hand-drawn flowcharts to code execution", master thesis, Texas A&M University, 2017.
  4. M. Mccracken, et al., “A multi-national, multi-institutional study of assessment of programming skills of first-year CS students,” Working group reports from ITiCSE on Innovation and technology in computer science education - ITiCSE-WGR 01, 2001.
  5. Wang, C., Mouchère, H., Viard-Gaudin, C., Jin, L.: Combined segmentation and recognition of online handwritten diagrams with high order Markov random field, 2016.
  6. Wu, J., Wang, C., Zhang, L., Rui, Y.: Offline sketch parsing via shapeness estimation.2015.
  7. Yun, X.L., Zhang, Y.M., Ye, J.Y., Liu, C.L.: Online handwritten diagram recognition with graph attention networks. 2019.
  8. Faster R-CNN: Towards real-time object detection with region proposal networks, S Ren, K He, R Girshick, J Sun - Advances in neural information processing systems, 2015.
  9. Karen Simonyan, Andrew Zisserman,Very DeepConvolutional Networks for Large-Scale Image Recognition, 2015.
  10. J. Puigcerver, "Are Multidimensional Recurrent Layers Really Necessary for Handwritten Text Recognition?" 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), Kyoto, 2017, pp. 67-72, doi: 10.1109/ICDAR.2017.20.
  11. U. Marti and H. Bunke. The IAM-database: An English Sentence Database forOff-line Handwriting Recognition. Int. Journal on Document Analysis and Recognition,Volume 5, pages 39 - 46, 2002.
  12. Schäfer, B., Keuper, M. &Stuckenschmidt, H. Arrow R-CNN for handwritten diagram recognition. IJDAR 24, 3–17, 2021.
Index Terms

Computer Science
Information Sciences

Keywords

Convolutional neural network flowchart grammar analysis image processing object detection sketches recognition