Course Descrption:
This course introduces fundamentals of image and video processing, including color image capture and representation; image/video compression; video networking; selected advanced image/video processing and communication techniques. Students will learn to implement selected algorithms in Python (Matlab). A term project will be required. Relevant publications will be provided as reference. Through this course, students would have to gain the classical knowledge and cutting-edge techniques.
Prerequisites:
Probability and Random Process, Signal and Systems, Digital Image Processing
Instructor:
Professor Zhan Ma, Room 332B, Email: mazhan@nju.edu.cn . Homepage
Teaching Assistants:
Zhiyuan Pu, Room 311, Email: zhiyuanpu@smail.nju.edu.cn
Course Schedule:
Friday 9-10, Room 仙 II - 105.
Office Hour:
Every Friday Before and After Class (or By appointment)
Text Book/References:
Y. Wang, J. Ostermann, and Y.Q.Zhang, Video Processing and Communications. Prentice Hall, 2002. 'Link' (Reference for image and video coding, motion estimation, and stereo)
Richard Szeliski, Computer Vision: Algorithms and Applications. (Available online:'Link') (Cover most of the material, except sparsity-based image processing and image and video coding
Grade Policy:
Final: 60%, Assignments: 40% (Programming & Written)
Projects (Projects 2019 References)
Syllabus and Course Material:
Week #1 9.11 视频通信简介Introduction to the video communication [pdf]
Week #2 9.18 图像编码Image Compression: Transform, Entropy Coding [pdf]
Week #3 9.25 视频编码Video Compression [pdf]
Week #4 10.09 图像视频标准 Image/Video Compression: Standards [
coding_standards_pt1.pdf, coding_standards_pt2.pdf] (Coutersy of Prof. Yao Wang)
Week #5 10.16 传输通信协议 Modern Media Transport: RTP, HTTP/WebSocket, WebRTC [pdf]
Week #6 10.23 网络测量 Network Measurement [pdf]
Week #7 10.30 内容缓存技术 CDN Caching and Cache De-Duplication [pdf]
Week #8 11.06 视频图像系统标准 HLS、 DASH/MMT standards [pdf]
Week #9 11.20 中期考核及课程设计介绍mid-term & course project introduction
Week #10 11.27 视觉质量评价及建模 Subjective quality assessment and quality Metrics [part1, part2]
Week #11 12.04 基于AI的图像视频编码 Learning for Image/Video Compression [lec11_智能编码的探索.pdf]
Week #12 12.11 基于AI的视频传输 Learning for Networking [lec12_learning_for_networking.pdf]
Week #13 12.18 低功耗视频处理 Green Video [lec13_GreenVideo.pdf]
Week #14 12.25 计算成像与编码Computational Imaging & Coding [lec14_计算成像_p1.pdf, lec14_计算成像_p2.pdf]
Week #15 01.08 视频通信的未来 The Future of Video Communication [FutureofVideoComm.pdf]
Week #16 01.15 课程设计答辩 Project Review