CFP last date
22 April 2024
Reseach Article

Techniques of Facial Synthesis: A Comprehensive Literature Review

by Deepti Chandra, Sanjeev Karmakar, Rajendra Hegadi
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 61 - Number 10
Year of Publication: 2013
Authors: Deepti Chandra, Sanjeev Karmakar, Rajendra Hegadi
10.5120/9966-4622

Deepti Chandra, Sanjeev Karmakar, Rajendra Hegadi . Techniques of Facial Synthesis: A Comprehensive Literature Review. International Journal of Computer Applications. 61, 10 ( January 2013), 34-41. DOI=10.5120/9966-4622

@article{ 10.5120/9966-4622,
author = { Deepti Chandra, Sanjeev Karmakar, Rajendra Hegadi },
title = { Techniques of Facial Synthesis: A Comprehensive Literature Review },
journal = { International Journal of Computer Applications },
issue_date = { January 2013 },
volume = { 61 },
number = { 10 },
month = { January },
year = { 2013 },
issn = { 0975-8887 },
pages = { 34-41 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume61/number10/9966-4622/ },
doi = { 10.5120/9966-4622 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T21:08:46.188739+05:30
%A Deepti Chandra
%A Sanjeev Karmakar
%A Rajendra Hegadi
%T Techniques of Facial Synthesis: A Comprehensive Literature Review
%J International Journal of Computer Applications
%@ 0975-8887
%V 61
%N 10
%P 34-41
%D 2013
%I Foundation of Computer Science (FCS), NY, USA
Abstract

As an important area of computer graphics, realistic image synthesis provides principles and techniques for creating realistic imagery through computations based upon models of real-world objects and behaviors. Facial expression is one of the primary communication means of the human. The ultimate goal of realistic image synthesis is to achieve perfect realism -the synthesized images are visually indistinguishable from their real-world counterparts. This area has widespread applications in industry and scientific research including 3D design, omputer animation, scientific visualization and virtual reality Facial expression synthesis has many useful applications in practice. How to synthesize facial expression images robustly and simply is still a challenging problem. This paper surveys the state of the art in this area.

References
  1. Stelios Krinidis, Ioan Buciu and Ioannis Pitas" Facial expression analysis and synthesis: A survey" Inter. Conf on Human Computer Interaction HCI 2003.
  2. Yun Sheng, Abdul H. Sadka, Ahmet M. Kondoz, "Automatic Single View-Based 3-D Face Synthesis for Unsupervised Multimedia Applications", IEEE Transactions On Circuits And Systems For Video Technology, Vol. 18, No. 7, July 2008.
  3. Yinlong Sun, "A Spectrum-Based Framework for Realistic Image Synthesis", Thesis, Simon Fraser University, 2000.
  4. Li-an Tang, and Thomas S. Huang, "Automatic Construction of 3D Human Face Models Based on 2D Images", Proceedings of ICIP'96, III, pp. 467-470, 1996.
  5. Y. C. Lee, D. Terzopoulos and Keith Waters. "Realistic modeling for facial animation", In SIGGRAGH'95 Conference Proceedings, pp. 55-62, Los Angeles, 1999.
  6. P. Ekman and W. V. Friesen, "Manual for the Facial Action Coding System", Palo Alto: Consulting Psychologists, 1977.
  7. Arman Savran, Ne?e Alyüz, Hamdi Dibeklio?lu, Oya Çeliktutan, Berk Gökberk, Bülent Sankur, Lale Akarun, "Bosphorus Database for 3D Face Analysis", Biometrics and Identity Management, Springer-Verlag Berlin, 2008.
  8. P. Ekman, "Unmasking the Hnman Face", New York: Prentice-Hall, 1971.
  9. Santanu Halder, Debotosh Bhattacharjee, Mita Nasipuri, "Face Synthesis (FASY) System for Generation of a Face Image from Human Description", IEEE Region 10 Colloquium and the Third International Conference on Industrial and Information Systems, Kharagpur, 2008.
  10. Volker Blanz, Thomas Vetter, "A Morphable Model for the Synthesis of 3D Faces", Proceedings of the 26th annual conference on Computer graphics and interactive techniques, 1999.
  11. Salvador E. Ayala-Raggi, Leopoldo Altamirano-Robles and Janeth Cruz-Enriquez, "Face Image Synthesis and Interpretation Using 3D Illumination-Based AAM Models", New Approaches to Characterization and Recognition of Faces, InTech, 2011.
  12. Volker Blanz, Thomas Vetter, "A Morphable Model for the Synthesis of 3D Faces", Proceedings of the 26th annual conference on Computer graphics and interactive techniques, 1999.
  13. Salvador E. Ayala-Raggi, Leopoldo Altamirano-Robles and Janeth Cruz-Enriquez, "Face Image Synthesis and Interpretation Using 3D Illumination-Based AAM Models", New Approaches to Characterization and Recognition of Faces, InTech, 2011.
  14. Tony Ezzat, Tomaso Poggio, "Facial Analysis and Synthesis Using Image-Based Models", Proceedings of the Workshop on the Algorithmic Foundations of Robotics, August 1996.
  15. D. Terzopoulos and K. Waters. "Analysis and synthesis of facial image sequences using physical and anatomical models", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol: 15, No: 6, pp: 569–579, 1993.
  16. Demetri Terzopoulos, Yuencheng Lee and M. Alex O. Vasilescu, "Model-Based and Image-Based Methods for Facial Image Synthesis, Analysis and Recognition", Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition (FG'04), Seoul, Korea, May, 3–8, 2004.
  17. T. Beier and S. Neely, "Feature-Based Image Metamorphosis," Computer Graphics, pp. 35-42, July 1992.
  18. P. Litwinowicz and L. Williams, "Animating Images with Drawings," Computer Graphics, pp. 235-242, Aug. 1990.
  19. S. Toelg and T. Poggio, "Towards an Example-Based Image Compression Architecture for Video-Conferencing," TechnicalReport 1494, MIT, 1994.
  20. P. Joshi, W. C. Tien, M. Desbrun, and F. Pighin, "Learning Controls for Blend Shape Based Realistic Facial Animation," Proc. Symp. Computer Animation (SCA '03), pp. 187-192, July 2003.
  21. Z. Liu, Y. Shan, and Z. Zhang, "Expressive Expression Mapping with Ratio Images," Computer Graphics, Proc. Ann. Conf. Series, pp. 271-276, Aug. 2001.
  22. [V. Blanz, C. Basso, T. Poggio, and T. Vetter, "Reanimating Faces in Images and Video," Proc. Eurographics Conf. , 2003
  23. M Kirby and M. Sirovich. Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE Transactions on Pattern Analysis and machine intelligence 1990.
  24. M Sirovich and M Kirby. Low-dimensional procedure for the characterization of human faces. Jurnal of the Optical Society of America pp519-524,1987.
  25. R. Ramanmoorthi. and P. Hanrahan. An efficient representation for irradiance environment maps. In SIGGRAPH,pp 497-500,2001.
  26. M Turk and A. Pentland. Eigenfaces for recongnition. Jurnal of Congnitive Neuroscience pp71-96,1991.
  27. YWang,l. Zhang,Z,liu,G. Hua,Z. Wen,Z. Zhang,and samaras . Face re-lighting from a single image under harsh lighting conditions. in IEEE Conference on Computer Vision and Partern Recgnition,Minnesota,June 2007.
  28. Y. Wang,L. Zhang,Z. Liu,G. Hua,Z. Wen,Z. Zhang,and D Samaras. Face re-lighting from a single image under arbitrary unkown lighting conditions. IEEE Transaction on Pattern Recognition and Machine Intelligence,319110;1968-1984,2009
  29. Y. Wang,L. Zhang,Z. Liu,G. Hua,Z. Wen,Z. Zhang,andD Samaras. Face re-lighting from a single image under arbitrary unkown lighting conditions. IEEE Transaction on Pattern Recognition and Machine Intelligence,319110;1968-1984,2009
  30. A. L. Yuille, D. S. Cohen, and P. W. Hallinan. Feature extraction from faces using deformable templates. International Journal of Computer Vision, 8(2):99-112, 1992.
  31. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham. Active shape mod¬els - Their training and application. Computer Vision and Image Understanding, 61(l):18-23, 1995.
  32. P. Belhumeur, J. Hespanha, andD. Kriegman. Eigenfaces vs. fisherfaces: Recogni¬tion using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):711-720,1997.
  33. K. -C. Lee, J. Ho, and D. Kriegman. Nine points of light: Accquiring subspaces for face recognition under variable lighting. In IEEE Conference on Computer Vision and Pattern Recognition, 357-362, Kauai, HI, USA, 2001.
  34. R. Ramamoorthi and R Hanrahan. An efficient representation for irradiance environment maps. In SIGGRAPH, pages 497-500, 2001.
  35. C. Tomasi and T. Kanade. Shape and motion from image streams under orthography:A factorization method. International Journal of Computer Vision, 9(2):137- 154,1992.
  36. M. A. O. Vasilescu and D. Terzopoulos. Multilinear analysis of image ensem¬bles: Tensorfaces. In European Conference on Computer Vision, Copenhagen, Denmark, May 2002.
  37. M. A. O. Vasilescu and D. Terzopoulos. Multilinear independent component analysis. In IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, 2005
  38. Y. G. Leclerc and A. F. Bobick. The direct computation of height from shading. In IEEE Conference on Computer Vision and Pattern Recognition, Maui, Hawaii, June 1991.
  39. M. Proesmans, L. V. Cool, and A. Oosterlinck. Active acquisition of 3d shape for moving objects. In International Conference on Image Processing, Lausanne, Switzerland, Sept. 1996.
  40. H. H. S. Ip and L. Yin. Constructing a 3d individualized head model from two orthogonal views. The Visual Computer, (12):254-266, 1996.
  41. M. Dimitrijevic, S. Ilic, and P. Fua. Accurate face models from uncalibrated and ill-lit video sequences. In IEEE Conference on Computer Vision and Pattern Recognition, volume II, pages 1034-1041, 2004.
  42. A. Golovinskiy, W. Matusik, H. Pfister, S. Rusinkiewica, and T. Funkhouser. A statistical model for synthesis of detailed facial geometry. ACM Transaction on Graphics, 25(3): 1025-1034, 2006.
  43. B. Amberg, A. Blake, A. Fitzgibbon, S. Romdhani, and T. Vetter. Reconstructing high quality face-surfaces using model based stereo. In International Conference on Computer Vision, Rio de Janeiro, Brazil, October 2007.
  44. S. R. Marschner and D. P. Greenberg. Inverse lighting for photography. In IST/SID Fifth Color Imaging Conference, Scattsdale, Arizona, USA, 1997.
  45. S. R. Marschner, B. Guenter, and S. Raghupathy. Modeling and rendering for realistic facial animation. In Rendering Techniques, pages 231-242. Springer, 2000.
  46. S. R. Marschner, S. Westin, E. Lafortune, K. Torance, and D. Greenberg. Image-based brdf measurement including human skin. In Rendering Techniques, pages 139- 152, Granada, Spin, 1999.
  47. T. Weyrich, W. Matusik, H. Pfister, B. Bickel, C. Donner, C. Tu, J. McAndless, J. Lee, A. Ngan, H. W. Jensen, and M. Gross. Analysis of human faces using a measurement-based skin reflectance model. ACM Transaction on Graphics, 25(3): 1013-1024, 2006.
  48. T. Weyrich, W. Matusik, H. Pfister, J. Lee, A. Ngan, H. W. Jensen, and M. Gross. A measurement-based skin reflectance model for face rendering and editing. In Technical Report, TR2005-046, Mitsubishi Electric Research Laboratories, Cambridge, MA, USA, 2005.
  49. Y. Wang, Z. Liu, G. Hua, Z. Wen, Z. Zhang, and D. Samaras. Face re-lighting from a single image under harsh lighting conditions. In IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, Minnesota, June 2007.
  50. Y. Wang, L. Zhang, Z. Liu, G. Hua, Z. Wen, Z. Zhang, and D. Samaras. Face re¬ lighting from a single image under arbitrary unknown lighting conditions. IEEE Transaction on Pattern Recogniton and Machine Intelligence, 31(11): 1968-1984, 2009.
  51. M. Brand. Voice puppetry. In SIGGRAPH, pages 21-28,1999.
  52. C. Bregler, M. Covell, and M. Slaney. Video rewrite: Driving visual speech with audio. In SIGGRAPH, pages 353-360, 1997.
  53. T. Ezzat, G. Geiger, and T. Poggio. Trainable videorealistic speech animation. In SIGGRAPH'02, pages 388-398, 2002.
  54. P. Joshi, W. C. Tien, M. Desbrun, and F. Pighin. Learning controls for blend shape based realistic facial animation. In Proceedings of the Symposium on Computer Animation (SCA'03), pages 187-192, San Diego, CA, USA, July 2003.
  55. B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin. Making faces. In SIGGRAPH, pages 55-66, 1998.
  56. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski,. and D. H. Salesin. Synthesizing realistic facial expressions from photographs. In SIGGRAPH, pages 75-84,1998.
  57. F. Pighin, D. H. Salesin, and R. Szeliski. Resynthesizing facial animation through 3d model-based tracking. International Conference on Computer Vision, pages 143-150, Kerkyra, Corfu, Greece, 1999
  58. Z. Liu, Y. Shan, and Z. Zhang. Expressive expression mapping with ratio images. SIGGRAPH, pages 271-276, 2001.
  59. J. Noh and U. Neumann. Expression cloning. In SIGGRAPH, pages 277-288, 2001
  60. R. W. Sumner and J. Popovic. Deformation tranfer for triangle meshes. In SIGGRAPH, pages 399-405, 2004.
  61. Q. Zhang, Z. Liu, B. Guo, D. Terzopoulos, and H. -Y. Shum. Geometry-driven photorealistic facial expression synthesis. IEEE Transaction on Visualization and Computer Graphics, 12(1):48-60, 2006.
  62. M. A. Sagar, D. Bullivant, G. D. Mallinson, P. J. Hunter, and I. W. Hunter. A virtual environment and model of the eye for surgical simulation. In SIGGRAPH, pages 205- 212,1994.
  63. S. P. Lee, J. B. Badler, and N. I. Badler. Eyes alive. In SIGGRAPH, pages 637- 644, 2002.
  64. L. Itti, N. Dhavale, and F. Pighin. Realistic avatar eye and head animation using a neurobiological model of visual attention. In Proceedings of SPIE, pages 64-78, San Diego, CA, USA, August 2003.
  65. J. JL Kajiya and T. L. Kay. Rendering fur with three dimensional textures. In SIGGRAPH, pages 271-280, July 1989.
  66. K. Anjyo, Y. Usami, and T. Kurihara. A simple method for extracting the natural beauty of hair. In SIGGRAPH, pages 111-120,1992.
  67. J. Stam. Multi-scale stochastic modeling of complext natural phenomena. Ph. D. thesis, University of Toronto, 1995.
  68. D. B. Goldman. Fake fur rendering. In SIGGRAPH, pages 127-134, 1997.
  69. J. JL Kajiya and T. L. Kay. Rendering fur with three dimensional textures. In SIGGRAPH, pages 271-280, July 1989.
  70. L. Chen, S. Saeyor, H. Dohi, and M. Ishzuka. A system ofpd hairstyle synthesis based on the wisp model The Visual Computer, 15(4): 159-170, 1999.
  71. W. Kong and M. Nakajima. Hair rendering by jittering and pseudo shadow. In Computer Graphics International, Geneva, Switzerland, June 2000.
  72. Y. Yu. Modeling realistic virtual hairstyles. In Pacific Graphics, pages 295-304,October 2001.
  73. J. T. Chang, J. Jin, and Y. Yu. A practical model for hair mutual interactions. In Symposium on Computer Animation, pages 73-80, 2002.
  74. S. Marschner, H. W. Jensen, M. Cammarano, S. Worley, and P. Hanrahan. Light scattering from human hair fibers. ACM Transaction on Graphics, 22(3):780-791, 2003.
  75. J. JL Kajiya and T. L. Kay. Rendering fur with three dimensional textures. In SIGGRAPH, pages 271-280, July 1989.
  76. S. Paris, H. M. Briceno, and R X. Sillion. Capture of hair geometry from multiple ;images. ACM Transaction on Graphics, 23(3):712-719, August 2004.
  77. S. Grabli, F. Sillion, S. R. Marschner, and J. E. Lengyl. Image-based hair capture by inverse lighting. In Graphics Interface, pages 51-58, Calgary, Alberta, May 2002.
  78. Y. Wei, E. Ofek, L. Quan, and H. -Y. Shum. Modeling hair from multiple views. ACM Transaction on Graphics, 24(3):816-820, 2005.
  79. F. Bertails, B. Audoly, M. -P. Cani, B. Querleux, F. Leroy, and J. -L. Leveque. Super-helices for predicting the dynamics of natural hair. ACM Transaction on Graphics, 25(3): 1180-1187, 2006.
  80. J. T. Moon and S. R. Marschner. Simulating multiple scattering in hair using a photon mapping approach. ACM Transaction on Graphics, 25(3): 1067-1074, 2006.
  81. J. T. Moon, B. Walter, and S. R. Marschner. Efficient multiple scattering in hair using spherical harmonics. ACM Transaction on Graphics, 27(3):31:1-31-7, 2008.
  82. J. T. Moon and S. R. Marschner. Simulating multiple scattering in hair using a photon mapping approach. ACM Transaction on Graphics, 25(3): 1067-1074, 2006.
  83. A. McAdams, A. Selle, K. Ward, E. Sifakis, and J. Teran. Detail preserving contin¬ uum simulation of stright hair. ACM Transaction on Graphics, 28(3):62:1-62:6, 2009.
  84. L. Wang, Y. Yu, K. Zhou, and B. Guo. Example-based hair geometry synthesis. ACM Transaction on Graphics, 28(3):56:1-56:9, 2009.
Index Terms

Computer Science
Information Sciences

Keywords

Facial Synthesis Eigen pictures FED Active Appearance Mode Parameterization