Computer Vision
CS-GY 6643

An important goal of signal processing and artificial intelligence (AI) is to equip computers with the capability of interpreting visual inputs. Computer vision is an area that deals with the construction of explicit, meaningful measurements and descriptions of physical objects from images. It includes many techniques from image processing, pattern recognition, geometric modeling, cognitive processing, and machine and deep learning. This course introduces students to the fundamental concepts and techniques in image processing and computer vision.
This is a graduate level course requiring working knowledge of linear algebra, data structures and proficiency in programming (python). Advanced undergraduates may enroll upon permission from instructor.
Course information
- Instructor
- Prof. Erdem Varol
- ev2240@nyu.edu
- Time
- Thursdays 11am-1:30pm
- Place
- 2 MetroTech Center, Room 801
Course team



Course details
Grading
Individual homework 18%, individual programming projects 45%, in-class midterm 15%, and final group project 22%.
Prerequisites
Working knowledge of linear algebra and data structures, plus proficiency in Python. Advanced undergraduates may enroll upon permission of the instructor.
Assignments and late policy
Homework and programming projects were submitted to Brightspace by 11:59pm on the due date. Programming projects were submitted as evaluated Jupyter notebooks.
Every hour that a project was late (rounded down) caused a 1% penalty on the total allotted grade.
Schedule
| Date | Topic | Materials | Assignments |
|---|---|---|---|
| September 5, 2024 | Intro and survey of topics | Lecture 1 slides, Python tutorial, Google Colab Setup | Homework 0 out: Join slack nyucomputervision.slack.com (Due September 11, 11:59pm) |
| September 12, 2024 | Image formation and filtering | Lecture 2 slides, Colab for Lecture 2, Szeliski 2.2, 2.3, 3.1, 3.2 | Homework 1 out, Project 1 out |
| September 19, 2024 | Non-linear filtering and edge detection | Lecture 3 slides, Colab for Lecture 3, Szeliski 3.3, 7.2 | Homework 1 due, September 19 10:59a |
| September 26, 2024 | Image recognition, Feature detection and matching | Lecture 4 slides, Colab for Lecture 4, Szeliski 6,7 | Final project team selection due, September 22 10:59am |
| October 3, 2024 | Contour tracking and Hough transforms | Lecture 5 slides, Colab for Lecture 5, Szeliski 7.3,7.4 | Project 1 due, October 4, 10:59am |
| October 10, 2024 | Image alignment | Lecture 6 slides, Colab for Lecture 6, Szeliski 8.1,8.2 | Homework 2 out, Final project proposal due, October 11, 11:59pm |
| October 17, 2024 | Segmentation | Lecture 7 slides, Colab for Lecture 7, Szeliski 7.5 | Homework 2 due, October 18, 11:59pm |
| October 24, 2024 | Midterm exam (in class) | Midterm Exam, Solution | |
| October 31, 2024 | Machine learning, optimization | Lecture 8 slides, Colab for Lecture 8 | Project 2 out (Due Nov. 18, 11:59am) |
| November 7, 2024 | Convolutional Neural Nets | Lecture 9 slides, Deep-STORM, 3D CNNs | Homework 3 out, Nov. 8 (Due Nov 21,10:59am) |
| November 14, 2024 | Learning based recognition | Lecture 10 slides, GradCAM, GradCAM Colab | Project 2 due, November 18, 11:59am |
| November 21, 2024 | Motion models, depth estimation and optical flow | Lecture 11 slides, RAFT Paper Presentation | Homework 3 due, November 21, 10:59am |
| November 28, 2024 | THANKSGIVING BREAK (No class) | ||
| December 5, 2024 | Learning based segmentation | Lecture 12 slides | Project 3 due, December 6, 11:59pm |
| December 12, 2024 | Final project presentations | Presentation Info | Video submission due December 12, 08:00am Write-up and code due December 19, 11:59pm |
This is the earliest archived version of this course.

