Neural Coding of Image/Video Signal

Written by  |  23/10/2017 - 00/00


Questing for coding image and video with superior efficiency on both compression performance and computation throughput is challenging. Since 2015, our team has been actively pursuing better coding solutions to represent image and video compactly and intelligently. 

Main Contributors:

Haojie Liu (PhD 18)

Tong Chen (PhD 19)

Ming Lu (PhD 20)

Zhihao Duan - Purdue PhD

Qi Xia (MS 19)

Neural Image Coding

Neural Video Coding

Joint Compression and Understanding



Selected Publication

  • Tong Chen, Haojie Liu, Qiu Shen, Tao Yue, Xun Cao, Zhan Ma, "DeepCoder: A Deep Neural Network Based Video Compression", IEEE VCIP, St. Petersburg, FL, Dec. 2017 [The Very First Learnt Video Compression]

  • Haojie Liu, Tong Chen, Qiu Shen, Tao Yue and Zhan Ma, "Deep Image Compression via End-to-End Learning", IEEE CVPR Workshop and Challenge on Learnt Image Compression, June 2018. [The Very First One Optimizaing Objective and Subjective Quality Jointly.]

  • Haojie Liu, Han Shen, Lichao Huang, Ming Lu, Tong Chen, and Zhan Ma, "Learned Video Compression via Joint Spatial-Temporal Correlation Exploration", AAAI, New York City,  Feb. 2020. 

  • Tong Chen, and Zhan Ma, "Variable bitrate image compression with quality scaling factors,"  IEEE ICASSP, Barcelona, Spain, May 2020. [The Very First One Dealing with Single Model for All]

  • Qi Xia, Haojie Liu, and Zhan Ma, 'Object-Based Image Coding: A Learning-Driven Revisit,'  IEEE ICME, London, UK, July 2020. [The Very First Learnt Object-based Compression]

  • Tong Chen, Haojie Liu, Ming Lu, and Zhan Ma, 'Neural Image Compression,' IEEE MMSP Grand Challenge  [Best Performing Image Coding Solution], Sept. 2020.

  • Tong Chen, Haojie Liu, Zhan Ma, Qiu Shen, Xun Cao, and Yao Wang, "End-to-End Learnt Image Compression via Nonlocal Attention Optimization and Improved Contenxt Modeling",  IEEE Trans. Image Processing, vol. 30, pp. 3179-3191, 2021.

  • Dandan Ding, Zhan Ma, Di Chen, Qingshuang Chen, Zoe Liu, and Fengqing Zhu, "Advances in Video Compression System Using Deep Neural Network: A Review and Case Studies",  Proceedings of the IEEE, vol. 109, no. 9, pp. 1494 - 1520, Sept. 2021.

  • Yueyu Hu, Wenhan Yang, Zhan Ma, and Jiaying Liu, "Learning End-to-End Lossy Image Compression: A Benchmark", accepted by IEEE Trans. Pattern Analysis and Machine Intelligence, March 2021.

  • Haojie Liu, Ming Lu, Zhan Ma, Fan Wang, Zhihuang Xie, Xun Cao, and Yao Wang, "Neural Video Coding using Multiscale Motion Compensation and Spatiotemporal Context Model", IEEE Trans. Circuits and Systems for Video Technology, vol. 31, no. 8, pp. 3182-3196, Aug. 2021 

  • Haojie Liu, Ming Lu, Zhiqi Chen, Xun Cao, Zhan Ma, and Yao Wang, "End-to-end Neural Video Coding Using a Compound Spatiotemporal Representation", IEEE Trans. Circuits and Systems for Video Technology, Jan. 2022.