Understand the 3D world from 2D images
Course Information
Term: Spring 2024
Class Level: Undergraduate
Activity Type: Lecture
Days & Times: Tuesday & Thursday 11:30 AM – 12:45 PM
Location: JO 4.102
Instructor: Prof. Yu Xiang
Office Location: ECSS 4.702
Office Hours: Tuesday & Thursday 2:00PM – 3:00PM
Teaching Assistant: Jishnu P
Office Hours: Monday 12:00PM – 1:00PM
All the course materials can be found here.
Course Description
Theory and practice of computer vision. Provides in-depth overview of computer vision, including geometric primitives and transformations, camera models, image features, epipolar geometry and stereo, structure from motion and SLAM, 3D reconstruction, variations of modern neural networks and various recognition problems such as object detection, semantic segmentation, and human pose estimation.
Textbooks
Richard Szeliski. Computer Vision: Algorithms and Applications. 2011th Edition. Springer.
ISBN-13: 978-1848829343
ISBN-10: 1848829345
Second Edition
David Forsyth, Jean Ponce. Computer Vision: A Modern Approach, 2nd Edition. Pearson, 2011. (Optional)
ISBN: 9789332550117
Richard Hartley. Multiple View Geometry in Computer Vision, 2nd Edition. Cambridge University Press, 2004. (Optional)
ISBN-13: 978-0521540513
ISBN-10: 0521540518
Grading Policy
- Homework (50%)
- Assignment 1 (10%)
- Assignment 2 (10%)
- Assignment 3 (10%)
- Assignment 4 (10%)
- Assignment 5 (10%)
- Midterm Exam (20%)
- Final Exam (25%)
- In-Class Activity (5%)
Homework
- Assignment 1 (PDF, programming)
- Assignment 2 (PDF, programming)
- Assignment 3 (PDF, programming)
- Assignment 4 (PDF, programming)
- Assignment 5 (PDF, programming)
Learning from the “Cracker Box”
Lectures
| Date | Topic |
| Week 1, 1/16 | Cancelled due to weather conditions |
| Week 1, 1/18, Lecture 1 | Introduction to Computer Vision (slides) |
| Week 2, 1/23, Lecture 2 | Intensity Surface and Gradients (slides, code) |
| Week 2, 1/25, Lecture 3 | Image Filtering and Convolution (slides, code) |
| Week 3, 1/30, Lecture 4 | Smoothing (slides, code) |
| Week 3, 2/1 | Cancelled due to travelling |
| Week 4, 2/6, Lecture 5 | Edge Detection (slides) |
| Week 4, 2/8, Lecture 6 | Corner Detection (slides) |
| Week 5, 2/13, Lecture 7 | Laplacian and Blob Detection (slides) |
| Week 5, 2/15, Lecture 8 | Scale Invariance and SIFT I (slides) |
| Week 6, 2/20, Lecture 9 | Scale Invariance and SIFT II (slides, quiz) |
| Week 6, 2/22, Lecture 10 | Geometric Primitives and Transformations (slides) |
| Week 7, 2/27, Lecture 11 | Camera Projection (slides) |
| Week 7, 2/29, Lecture 12 | Camera Calibration (slides) |
| Week 8, 3/5, Lecture 13 | Epipolar Geometry (slides) |
| Week 8, 3/7 | Midterm Exam |
| Week 9, 3/12 | Spring Break |
| Week 9, 3/14 | Spring Break |
| Week 10, 3/19, Lecture 14 | Epipolar Geometry and Stereo (slides) |
| Week 10, 3/21, Lecture 15 | Structure from Motion I (slides) |
| Week 11, 3/26, Lecture 16 | Structure from Motion II (slides) |
| Week 11, 3/28, Lecture 17 | Convolution Neural Networks I (slides) |
| Week 12, 4/2, Lecture 18 | Convolution Neural Networks II (slides) |
| Week 12, 4/4, Lecture 19 | Convolution Neural Networks III (slides) |
| Week 13, 4/9, Lecture 20 | Recurrent Neural Networks I (slides) |
| Week 13, 4/11, Lecture 21 | Recurrent Neural Networks II (slides) |
| Week 14, 4/16, Lecture 22 | Transformer I (slides) |
| Week, 14, 4/18, Lecture 23 | Transformer II (slides) |
| Week 15, 4/23, Lecture 24 | Object Detection I (slides) |
| Week 15, 4/25, Lecture 25 | Object Detection II (slides, quiz) |
| Week 16, 4/30, Lecture 26 | Semantic Segmentation (slides) |
| Week 16, 5/2 | Final Exam |