Digital Visual Effects

Digital Visual Effects, Spring 2005

Forum

Jump to...

02/23 introduction
03/02 cameras
03/09 image morphing
03/16 feature matching
03/23 motion estimation
03/30 image stitching
04/06 camera calibration
04/20 structure from motion
04/27 matting and compositing
05/04 structure from motion II
05/11 Image-based modeling
05/18 3D Photography
05/25 3D Photography II
06/08 Making faces
06/15 Texture synthesis and Image-based lighting

Lectures

Date	Topic	slides	scribe	readings/related links

2005/02/23	introduction	ppt/pdf/4-up pdf		405: The Movie Gatech VFX course (2004, 2003, 2002, 2001)
2005/03/02	cameras	ppt/pdf/4-up pdf	scribe	Ramanath, Snyder, Bilbro, and Sander. Demosaicking Methods for Bayer Color Arrays, Journal of Electronic Imaging, 11(3), pp306-315. Paul E. Debevec, Jitendra Malik. Recovering High Dynamic Range Radiance Maps from Photographs, SIGGRAPH 1997. http://www.howstuffworks.com/digital-camera.htm http://electronics.howstuffworks.com/autofocus.htm http://www.worldatwar.org/photos/whitebalance/index.mhtml http://www.100fps.com/
2005/03/09	image morphing	ppt/pdf/4-up pdf	scribe	George Wolberg, Image morphing: a survey, The Visual Computer, 1998, pp360-372. Thaddeus Beier, Shawn Neely. Feature-Based Image Metamorphosis, SIGGRAPH 1992. Michael Jackson's "Black or White" MTV
2005/03/16	feature matching	ppt/pdf/4-up pdf	scribe	Chris Harris, Mike Stephens, A Combined Corner and Edge Detector, 4th Alvey Vision Conference, 1998, pp147-151. David Lowe, Distinctive Image Features from Scale-Invariant Keypoints, IJCV, 60(2), 2004, pp91-110. SIFT Keypoint Detector, David Lowe. Matlab SIFT Tutorial, University of Toronto.
2005/03/23	motion estimation	ppt/pdf/4-up pdf	scribe	B.D. Lucas and T. Kanade, An Iterative Image Registration Technique with an Application to Stereo Vision, Proceedings of the 1981 DARPA Image Understanding Workshop, 1991, pp121-130. J. R. Bergen, P. Anandan, K.J. Hanna and R. Hingorani, Hierarchical Model-Based Motion Estimation, ECCV 1992, pp237-252. J. Shi and C. Tomasi, Good Features to Track, CVPR 1994, pp593-600. Michael Black and P. Anandan, The robust estimation of multiple motions: parametric and piecewise-smooth flow fields, Computer Vision and Image Understanding, pp75-104.
2005/03/30	image stitching	ppt/pdf/4-up pdf	scribe	Richard Szeliski, Image Alignment and Stitching, unpublished draft, 2005. Richard Szeliski and H.-Y. Shum, Creating full view panoramic image mosaics and texture-mapped models, SIGGRAPH 1997. M. Brown and D. G. Lowe, Recognising Panorama, ICCV 2003.
2005/04/06	camera calibration	ppt/pdf/4-up pdf	scribe	Manolis Lourakis and Antonis Argyros, The Design and Implementation of a Generic Sparse Bundle Adjustment Software Package Based on the Levenberg-Marquardt Algorithm, FORTH-ICS/TR-320, 2004. K. Madsen, H.B. Nielsen, O. Timgleff, Methods for Non-Linear Least Squares Problems, 2004. sba: A Generic Sparse Bundle Adjustment Package Camera Calibration Toolbox for Matlab
2005/04/20	structure from motion	ppt/pdf/4-up pdf	scribe#1 scribe#2 scribe#3 scribe#4	Carlo Tomasi, The Singular Value Decomposition, Mathematical Modeling of Continuous Systems course note, 2004. Richard Hartley, In Defense of the 8-point Algorithm, ICCV, 1995. Andrew W. Fitzgibbon and Andrew Zisserman, Automatic Camera Tracking, Video Registration, 2003. Carlo Tomasi and Takeo Kanade, Shape and Motion from Image Streams: A Factorization Method, Proceedings of Natl. Acad. Sci., 1993.
2005/04/27	matting and compositing environment matting	ppt/pdf/4-up pdf ppt/pdf/4-up pdf	scribe	Yung-Yu Chuang, Brian Curless, David Salesin, and Richard Szeliski, A Bayesian Approach to Digital Matting, CVPR 2001, pp264-271. Yung-Yu Chuang, Aseem Agarwala, Brian Curless, David H. Salesin, Richard Szeliski, Video Matting of Complex Scenes, SIGGRAPH 2002. Yung-Yu Chuang, Dan B. Goldman, Brian Curless, David H. Salesin, Richard Szeliski, Shadow Matting and Compositing, SIGGRAPH 2003. D. Zongker, D. M. Werner, B. Curless, and D. H. Salesin. Environment Matting and Compositing, SIGGRAPH 1999, pp205-214. Yung-Yu Chuang, Douglas E. Zongker, Joel Hindorff, Brian Curless, David H. Salesin, Richard Szeliski, Environment Matting Extensions: Towards Higher Accuracy and Real-Time Capture, SIGGRAPH 2000.
2005/05/04	structure from motion II	ppt/pdf/4-up pdf	scribe	David Jacobs, Linear Fitting with Missing Data for Structure from Motion, Computer Vision and Image Understanding, 2001. Peter Sturm and Bill Triggs, A Factorization Based Algorithm for Multi-Image Projective Structure from Motion, ECCV 1996. Shyjan Mahamud, Martial Hebert, Yasuhiro and Jean Ponce, Provably-Convergent Iterative Methods for Projective Structure from Motion, ICCV 2001.
2005/05/11	image-based modeling	ppt/pdf/4-up pdf	scribe	P. Debevec, C. Taylor and J. Malik, Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach, SIGGRAPH 1996. Y. Horry, K. Anjyo and K. Arai, Tour Into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image, SIGGRAPH 1997.
2005/05/18	3D Photography	ppt/pdf/4-up pdf	scribe	D. Scharstein and R. Szeliski. A Texonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithm, IJCV 2002. S. Seitz and C. Dyer. Photorealistic Scene Reconstruction by Voxel Coloring, CVPR 1997. J.-Y. Bouguet and P. Perona. 3D Photography on Your Desk, ICCV 1998. T. Zickler, P. Belhumeur and D. Kriegman. Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction, ECCV 2002. A. Hertzman and S. Seitz. Shape and Materials by Example: A Photometric Stereo Appraoch, CVPR 2003.
2005/05/25	3D Photography II	ppt/pdf/4-up pdf	scribe	S. Rusinkiewicz and M. Levoy. Efficient Variants of the ICP Algorithm, 3DIM 2001. B. Curless and M. Levoy. A Volumetric Method for Building Complex Models from Range Images, SIGGRAPH 1996.
2005/06/08	Making faces	ppt/pdf/4-up pdf	scribe	F. Pighin, J. Hecker, D. Lischinski, D. H. Salesin, and R. Szeliski. Synthesizing realistic facial expressions from photographs. SIGGRAPH 1998, pp75-84. Li Zhang, Noah Snavely, Brian Curless, Steven M. Seitz, Spacetime Faces: High Resolution Capture for Modeling and Animation, SIGGRAPH 2004. Blanz, V. and Vetter, T., A Morphable Model for the Synthesis of 3D Faces, SIGGRAPH 1999, pp187-194. Paul Debevec, Tim Hawkins, Chris Tchou, Haarm-Pieter Duiker, Westley Sarokin, Mark Sagar, Acquiring the Reflectance Field of a Human Face, SIGGRAPH 2000. Paul Debevec, Chris Tchou, Andreas Wenger, Tim Hawkins, Andy Gardner, Brian Emerson, Ansul Panday, A Lighting Reproduction Approach to Live-Action Compositing, SIGGRAPH 2002. Christoph Bregler, Malcolm Slaney, Michele Covell, Video Rewrite: Driving Visual Speeach with Audio, SIGGRAPH 1997.
2005/06/15	Texture synthesis and Image-based lighting	ppt/pdf/4-up pdf		Alexei A. Efros, Thomas K. Leung, Texture Synthesis by Non-parametric Sampling, ICCV 1999. Li-Yi Wei, Marc Levoy, Fast Texture Synthesis Using Tree-Structured Vector Quantization, SIGGRAPH 2000. Aaron Hertzmann, Charles E. Jacobs, Nuria Oliver, Brian Curless, David H. Salesin, Image Analogies, SIGGRAPH 2001. Alexei A. Efros, William T. Freeman, Image Quilting for Texture Synthesis and Transfer, SIGGRAPH 2001. Paul Debevec, Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography, SIGGRAPH 1998.