Course Descrption:
This course introduces fundamentals of image and video processing, including color image capture and representation; image/video compression; video networking; selected advanced image/video processing and communication techniques. Students will learn to implement selected algorithms in Python (Matlab). A term project will be required. Relevant publications will be provided as reference. Through this course, students would have to gain the classical knowledge and cutting-edge techniques.
Prerequisites:
Probability and Random Process, Signal and Systems, Digital Image Processing
Instructor:
Professor Zhan Ma, Room 332B, Email: mazhan@nju.edu.cn . Homepage
Professor Qiu Shen, Room 332B, Email: shenqiu@nju.edu.cn . Homepage
Teaching Assistants:
Qi Xia, Room 311, Email: xiaq_890@163.com
Course Schedule:
Friday 9-10, Room 仙 II - 215.
Office Hour:
Every Wednesday Before and After Class (or By appointment)
Text Book/References:
Y. Wang, J. Ostermann, and Y.Q.Zhang, Video Processing and Communications. Prentice Hall, 2002. 'Link' (Reference for image and video coding, motion estimation, and stereo)
Richard Szeliski, Computer Vision: Algorithms and Applications. (Available online:'Link') (Cover most of the material, except sparsity-based image processing and image and video coding
Grade Policy:
Final: 60%, Assignments: 40% (Programming & Written)
Syllabus and Course Material:
Week #1 Introduction to the video communication [pdf]
Week #2 Image/Video Capture and Processing [pdf]
Week #3 Video Compression: Intra and Inter Prediction [pdf]
Week #4 Image Compression: Transform, Entropy Coding [pdf]
Week #5 Video Compression: Standards [p1, p2 ] (Courtesy of Prof. Yao Wang at NYU)
Week #6 Modern Media Transport: RTP, HTTP/WebSocket, WebRTC [pdf]
Week #7 Network Measurement [pdf]
Week #8 Subjective quality assessment and quality Metrics [pdf]
Week #9 MPEG DASH/MMT standards
Week #10 Learning for Compression
Week #12 Immersive quality models
Week #13 Green Video
Week #14 Collaborative Video Processing
Week #15 Learning for Networking [pdf]
Week #16 Final Project Review
Week #17 Final Project Review