Digital Visual Effects

Digital Visual Effects, Spring 2011

Forum

Jump to...

02/23 introduction
03/02 cameras
03/02 HDR Imaging
03/09 tone mapping
03/16 image morphing
03/23 features
03/30 image stitching
04/13 motion estimation
04/20 camera calibration
04/27 structure from motion
05/04 matting and compositing
05/11 Image-based modeling
05/18 3D Photography
05/25 Computational Photography
06/01 Computational Photography
06/08 Stereoscopic media
06/15 Image-based lighting and faces

Lectures

Date	Topic	slides	readings/related links

2011/02/23	introduction	ppt/pdf/4-up pdf	405: The Movie Gatech VFX course (2007, 2006, 2005, 2004, 2003)
2011/03/02	cameras	ppt/pdf/4-up pdf	Ramanath, Snyder, Bilbro, and Sander. Demosaicking Methods for Bayer Color Arrays, Journal of Electronic Imaging, 11(3), pp306-315.
2011/03/02	HDR imaging	ppt/pdf/4-up pdf	Paul E. Debevec, Jitendra Malik. Recovering High Dynamic Range Radiance Maps from Photographs, SIGGRAPH 1997. G. Ward. Fast Robust Image Registration for compositing High Dynamic Range Photographs from Hand-held Exposures, Journal of Graphics Tools, 2003. Notes on Robertson's algorithm
2011/03/09	tone mapping	ppt/pdf/4-up pdf	Erik Reinhard, Michael Stark, Peter Shirley, Jim Ferwerda, Photographics Tone Reproduction for Digital Images, SIGGRAPH 2002. Raanan Fattal, Dani Lischinski, Michael Werman, Gradient Domain High Dynamic Range Compression, SIGGRAPH 2002. Fredo Durand, Julie Dorsey, Fast Bilateral Filtering for the Display of High Dynamic Range Images, SIGGRAPH 2002.
2011/03/16	image morphing	ppt/pdf/4-up pdf	George Wolberg, Image morphing: a survey, The Visual Computer, 1998, pp360-372. Thaddeus Beier, Shawn Neely. Feature-Based Image Metamorphosis, SIGGRAPH 1992. Michael Jackson's "Black or White" MTV Morphing software review
2011/03/23 2011/03/30	features	ppt/pdf/4-up pdf	Chris Harris, Mike Stephens, A Combined Corner and Edge Detector, 4th Alvey Vision Conference, 1998, pp147-151. David Lowe, Distinctive Image Features from Scale-Invariant Keypoints, IJCV, 60(2), 2004, pp91-110. Known implementations of SIFT. SIFT Keypoint Detector, David Lowe. Matlab SIFT Tutorial, University of Toronto. Matthew Brown, Richard Szeliski, Simon Winder, Multi-Scale Oriented Patches, MSR-TR-2004-133, 2004.
2011/03/30	image stitching	ppt/pdf/4-up pdf	Richard Szeliski, Image Alignment and Stitching: A Tutorial, Foundations and Trends in Computer Graphics and Computer Vision, 2006. Richard Szeliski and H.-Y. Shum, Creating full view panoramic image mosaics and texture-mapped models, SIGGRAPH 1997. M. Brown and D. G. Lowe, Recognising Panorama, ICCV 2003.
2011/04/13	motion estimation	ppt/pdf/4-up pdf	B.D. Lucas and T. Kanade, An Iterative Image Registration Technique with an Application to Stereo Vision, Proceedings of the 1981 DARPA Image Understanding Workshop, 1991, pp121-130. S. Baker and I. Matthews, Lucas-Kanade 20 Years On: A Unifying Framework, IJCV, 2004, pp221-255. J. R. Bergen, P. Anandan, K.J. Hanna and R. Hingorani, Hierarchical Model-Based Motion Estimation, ECCV 1992, pp237-252. J. Shi and C. Tomasi, Good Features to Track, CVPR 1994, pp593-600. Michael Black and P. Anandan, The robust estimation of multiple motions: parametric and piecewise-smooth flow fields, Computer Vision and Image Understanding, pp75-104.
2011/04/20	camera calibration	ppt/pdf/4-up pdf	K. Madsen, H.B. Nielsen, O. Timgleff, Methods for Non-Linear Least Squares Problems, 2004. Camera Calibration Toolbox for Matlab
2011/04/27	structure from motion	ppt/pdf/4-up pdf	Richard Hartley, In Defense of the 8-point Algorithm, ICCV, 1995. Carlo Tomasi and Takeo Kanade, Shape and Motion from Image Streams: A Factorization Method, Proceedings of Natl. Acad. Sci., 1993. Manolis Lourakis and Antonis Argyros, The Design and Implementation of a Generic Sparse Bundle Adjustment Software Package Based on the Levenberg-Marquardt Algorithm, FORTH-ICS/TR-320, 2004. sba: A Generic Sparse Bundle Adjustment Package
2011/05/04	matting and compositing	ppt/pdf/4-up pdf	Yung-Yu Chuang, Brian Curless, David Salesin, and Richard Szeliski, A Bayesian Approach to Digital Matting, CVPR 2001, pp264-271. Yung-Yu Chuang, Aseem Agarwala, Brian Curless, David H. Salesin, Richard Szeliski, Video Matting of Complex Scenes, SIGGRAPH 2002.
2011/05/11	image-based modeling	ppt/pdf/4-up pdf	P. Debevec, C. Taylor and J. Malik, Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach, SIGGRAPH 1996. Y. Horry, K. Anjyo and K. Arai, Tour Into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image, SIGGRAPH 1997.
2011/05/18	3D Photography	ppt/pdf/4-up pdf	D. Scharstein and R. Szeliski. A Texonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithm, IJCV 2002. S. Seitz and C. Dyer. Photorealistic Scene Reconstruction by Voxel Coloring, CVPR 1997. J.-Y. Bouguet and P. Perona. 3D Photography on Your Desk, ICCV 1998. A. Hertzman and S. Seitz. Shape and Materials by Example: A Photometric Stereo Appraoch, CVPR 2003.
2011/05/25 2011/06/01	Computational Photography Bilateral Filters Graph cut GrabCut Gradient domain	ppt/pdf/4-up pdf ppt/pdf/4-up pdf ppt/pdf/4-up pdf ppt/pdf/4-up pdf ppt/pdf/4-up pdf	Patrick Perez, Michel Gangnet, Andrew Blake, Poisson Image Editing, SIGGRAPH 2003. Dani Lischinski, Zeev Farbman, Matt Uytendaelle and Richard Szeliski. Interactive Local Adjustment of Tonal Values. SIGGRAPH 2006. Carsten Rother, Andrew Blake, Vladimir Kolmogorov, GrabCut - Interactive Foreground Extraction Using Iterated Graph Cuts, SIGGRAPH 2004. Aseem Agarwala, Mira Dontcheva, Maneesh Agrawala, Steven Drucker, Alex Colburn, Brian Curless, David H. Salesin, Michael F. Cohen, Interactive Digital Photomontage, SIGGRAPH 2004. Sylvain Paris and Fredo Durand. A Fast Approximation of the Bilateral Filter using a Signal Processing Approach. ECCV 2006. Soonmin Bae, Sylvain Paris and Fredo Durand. Two-scale Tone Management for Photographic Look. SIGGRAPH 2006.
2011/06/08	stereoscopic media	ppt/pdf/4-up pdf	C.-H. Chang, C.-K. Liang and Y.-Y. Chuang, Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images, IEEE TMM 2011.
2011/06/15	Faces and IBL	ppt/pdf/4-up pdf	Paul Debevec, Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography, SIGGRAPH 1998. F. Pighin, J. Hecker, D. Lischinski, D. H. Salesin, and R. Szeliski. Synthesizing realistic facial expressions from photographs. SIGGRAPH 1998, pp75-84. Li Zhang, Noah Snavely, Brian Curless, Steven M. Seitz, Spacetime Faces: High Resolution Capture for Modeling and Animation, SIGGRAPH 2004. Blanz, V. and Vetter, T., A Morphable Model for the Synthesis of 3D Faces, SIGGRAPH 1999, pp187-194. Paul Debevec, Tim Hawkins, Chris Tchou, Haarm-Pieter Duiker, Westley Sarokin, Mark Sagar, Acquiring the Reflectance Field of a Human Face, SIGGRAPH 2000. Paul Debevec, Chris Tchou, Andreas Wenger, Tim Hawkins, Andy Gardner, Brian Emerson, Ansul Panday, A Lighting Reproduction Approach to Live-Action Compositing, SIGGRAPH 2002. Christoph Bregler, Malcolm Slaney, Michele Covell, Video Rewrite: Driving Visual Speeach with Audio, SIGGRAPH 1997. Tony Ezzat, Gadi Geiger, Tomaso Poggio, Trainable Videorealistic Speech Animation, SIGGRAPH 2002.