CVFX Lecture 5: Graph cut segmentation, video matting, and matting extensions

ECSE-6969 Computer Vision for Visual Effects
Rich Radke, Rensselaer Polytechnic Institute
Lecture 5: Graph cut segmentation, video matting, and matting extensions (2/6/14)
0:00:13 Hard segmentation
0:02:47 Graph cuts
0:10:14 Edge weights for matting
0:16:33 Max flow demo
0:19:49 Hard segmentation with graph cuts demo
0:24:33 From a hard segmentation to a matte
0:26:49 GrabCut
0:30:01 Video matting
0:37:18 Rotoscoping
0:43:38 Examples from movies
0:49:13 Shadows
0:51:21 Refractive objects
0:52:57 Flash matting
0:55:40 Environment matting
0:58:08 The ICT Light Stage
Follows Sections 2.7-2.9 of the textbook, cvfxbook.com
Key references:
Y. Boykov and M. Jolly. Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. In IEEE International Conference on Computer Vision (ICCV), 2001.
dx.doi.org/10.1...
C. Rother, V. Kolmogorov, and A. Blake. GrabCut: Interactive foreground extraction using iterated graph cuts. In ACM SIGGRAPH (ACM Transactions on Graphics), 2004.
dx.doi.org/10.1...
N. Apostoloff and A. Fitzgibbon. Bayesian video matting using learnt image priors. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2004.
dx.doi.org/10.1...
A. Agarwala, A. Hertzmann, D. Salesin, and S. Seitz. Keyframe-based tracking for rotoscoping and animation. In ACM SIGGRAPH (ACM Transactions on Graphics), 2004.
dx.doi.org/10.1...
P. Debevec, A. Wenger, C. Tchou, A. Gardner, J. Waese, and T. Hawkins. A lighting reproduction approach to live-action compositing. In ACM SIGGRAPH (ACM Transactions on Graphics), 2002.
dx.doi.org/10.1...
D. Zongker, D. Werner, B. Curless, and D. Salesin. Environment matting and compositing. In ACM SIGGRAPH (ACM Transactions on Graphics), 1999.
dx.doi.org/10.1...