CFP last date
20 May 2024
Reseach Article

Android Application to Assist Visually Impaired with Outfit Coordination

by Noha Kareem, Abeer Hamdy, Khaled Nagaty
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 108 - Number 19
Year of Publication: 2014
Authors: Noha Kareem, Abeer Hamdy, Khaled Nagaty
10.5120/19018-0086

Noha Kareem, Abeer Hamdy, Khaled Nagaty . Android Application to Assist Visually Impaired with Outfit Coordination. International Journal of Computer Applications. 108, 19 ( December 2014), 11-19. DOI=10.5120/19018-0086

@article{ 10.5120/19018-0086,
author = { Noha Kareem, Abeer Hamdy, Khaled Nagaty },
title = { Android Application to Assist Visually Impaired with Outfit Coordination },
journal = { International Journal of Computer Applications },
issue_date = { December 2014 },
volume = { 108 },
number = { 19 },
month = { December },
year = { 2014 },
issn = { 0975-8887 },
pages = { 11-19 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume108/number19/19018-0086/ },
doi = { 10.5120/19018-0086 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T22:43:22.869884+05:30
%A Noha Kareem
%A Abeer Hamdy
%A Khaled Nagaty
%T Android Application to Assist Visually Impaired with Outfit Coordination
%J International Journal of Computer Applications
%@ 0975-8887
%V 108
%N 19
%P 11-19
%D 2014
%I Foundation of Computer Science (FCS), NY, USA
Abstract

The paper presents an android based application to assist visually impaired with outfit coordination process. The application helps them to be independent in their decisions while shopping or getting ready for the day. The application matches apparel image input with user's previously saved closet items, then provides the user with the possible matching item suggestions. The matching process is done based on the item outline and dominating colours. In order to develop this application five main components have been developed: 1. Two Region of interest (ROI) extraction components facilitating feature and colour extraction; 2. An outline detection component to determine whether an item is a top, skirt or a pair of trousers; 3. A colour recognition component to extract dominant colours of an apparel image; 4. A descriptive colour verbal feedback; 5. A matching component based on item outline and colours to coordinate with others in the user's closet. The output to the user includes the descriptive colours, communicated via audio, indicating the 3 dominant colours using their descriptive names - selected from a pool of 581 different colour shades. Other output is the outline details of the matching items. The application was developed and tested on Android 2. 2 (Froyo) and the results showed that the ROI extraction and outline detection components perform well. The colour recognition and descriptive name generation modules outperforms the current ones.

References
  1. World Health Organization, "Visual impairment and blindness," October 2013. [Online]. Available: http://www. who. int/mediacentre/factsheets/fs282/en/. [Accessed 29 May 2014].
  2. M. A. Burton, E. Brady, R. Brewer, C. Neylan, J. P. Bigham and A. Hurst, "Crowdsourcing Subjective Fashion Advice Using VizWiz: Challenges and Opportunities," ASSETS, pp. 135-142, 22-24 October 2012.
  3. E. Hsu, C. Paz and S. Shen, "Clothing Image Retrieval for Smarter Shopping," California, 2011.
  4. T. Iwata, S. Watanabe and H. Sawada, "Fashion Coordinates Recommender System using Photographs from Fashion Magazines," in Twenty-Second International Joint Conference on Artificial Intelligence, 2-4 Hikaridai, Seika-cho, Soraku-gun, Kyoto, Japan, 2011.
  5. J. Rose, "Closet Buddy: Dressing the Visually Impaired," ACM SE, pp. 611-615, 10-12 March 2006.
  6. N. Paisios, L. Subramanian and A. Rubinsteyn, "Choosing which Clothes to Wear Confidently: A Tool for Pattern Matching," New York, 2012.
  7. S. Yuan, Y. Tian and A. Arditi, "Clothing Matching for Visually Impaired Persons," IOS press, New York, 2011.
  8. OpenCV, [Online]. Available: http://opencv. org/.
  9. K. J. Walsh, "rgb," Copyright © 2010 Kevin J. Walsh, 2010. [Online]. Available: http://web. njit. edu/~kevin/rgb. txt. html. [Accessed 20 November 2012].
  10. jsoup, "jsoup: Java HTML Parser," [Online]. Available: http://jsoup. org/.
  11. OpenCV manager, "OpenCV Manager," [Online]. Available: https://play. google. com/store/apps/details?id=org. opencv. engine&hl=en.
  12. S. Suzuki and K. Abe, "Topological Structural Analysis of Digitized Binary Images by Border Following," CVGIP, vol. 30, no. 1, pp. 32-46, 1985.
  13. Find contours, [Online]. Available: http://docs. opencv. org/modules/imgproc/doc/structural_analysis_and_shape_descriptors. html#findcontours.
  14. P. Wagner, "Extracting Contours with OpenCV," 26 May 2012. [Online]. Available: http://www. bytefish. de/blog/extracting_contours_with_opencv/. [Accessed 30 May 2014].
  15. Draw contours, [Online]. Available: http://docs. opencv. org/modules/imgproc/doc/structural_analysis_and_shape_descriptors. html#drawcontours.
  16. D. Douglas and T. Peucker, "Algorithms for the reduction of the number of points required to represent a digitized line or its caricature," The Canadian Cartographer , vol. 10, no. 2, p. 112–122 , 1973.
  17. Approximate polygonal curves, 2014. [Online]. Available: http://docs. opencv. org/modules/imgproc/doc/structural_analysis_and_shape_descriptors. html#approxpolydp. [Accessed 31 May 2014].
  18. Abid Rahman, "Contours-2: brotherhood," 2012. [Online]. Available: http://opencvpython. blogspot. com/2012/06/contours-2-brotherhood. html. [Accessed 3 June 2013].
  19. D. G. Lowe, "Object recognition from local scale-invariant features," in The Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, 1999.
  20. B. Herbert, T. Tuytelaars and L. V. Gool, ""Surf: Speeded up robust features," Computer Vision–ECCV , pp. 404-417, 2006. Athi, "Color Quantization," [Online]. Available: https://www. mathworks. com/matlabcentral/fileexchange/31687-color-quantization.
  21. Athi, "Color Quantization," [Online]. Available: https://www. mathworks. com/matlabcentral/fileexchange/31687-color-quantization.
  22. K-menas, [Online]. Available: http://docs. opencv. org/modules/core/doc/clustering. html#kmeans.
  23. D. Cardani, "Adventures in HSV Space". M. Specht, "Using perceptually uniform color spaces for imagesteganography steganography: An enhancement of the Least Significant Bit method".
  24. Dataset images from coldwatercreek. com, dorothyperkins. com, esprit. com, gap. com, hm. com, missselfridge. com, net-a-porter. com, ralphlauren. com and topshop. com.
Index Terms

Computer Science
Information Sciences

Keywords

Colour Blindness Visual Impairment Android Computer Vision Outfit Coordination Clothes Matching Apparel.