Past Project: Green Video

Written by  |  01/08/2017 - 00/00

Video dominates the Internet traffic, and is typically in compressed format for delivery and exchange.  Energy or power is consumed for video encoding, transmission, decoding, and display.  It is still a critical issue for battery powered devices, such as SmartPhones.  Intuitively, the more bits exchanged, the more energy consumed.  Green video project is aimed to understand the enery consumption for video processing and communication and develop analytic models to guide the energy-efficient video encoding, delivery and presentation.  In addition, a Green metadata standard is developed by the ISO/IEC MPEG experts and outputed as an international standard recommendation - ISO/IEC 23001-11, for energy-efficient video consumption.

This project has spaned years with the collaborative efforts across the VIsion Lab at New York University,  the Samsung Research America  and the Vision Lab at Nanjing University.

 

 

Publication

  • Felix Fernandes, Esmaeil Faramarzi, Xin Li, Zhan Ma, and Xavier Ducloux, "Mobile Display Power Reduction for Video using Standardized Metadata", accepted by IEEE Trans. Mobile Computing, April 2018.

  • Yao Liu, Mengbai Xiao, Ming Zhang, Xin Li, Mian Dong, Zhan Ma, Zhenhua Li, and Songqing Chen, "Content-Adaptive Display Power Saving for Internet Video Applications on Mobile Devices", ACM TOMM, vol. 12, no. 5s, Dec. 2016. 

  • Yao Liu, Mengbai Xiao, Ming Zhang, Xin Li, Mian Dong, Zhan Ma, Zhenhua Li, and Songqing Chen. "GoCAD: GPU-assisted Online Content Adaptive Display Power Saving for Mobile Devices in Internet Streaming". The 25th International World Wide Web Conference (WWW), Apr. 11-15, 2016, Montreal, Canada.

  • Felix Fernandes, Xavier Ducloux, Zhan Ma, Esmaeil Faramarzi, Patrick Gendron and Jiangtao Wen, "The Green Metadata Standard for Energy-Efficient Video Consumption", IEEE Multimedia, 2015

  • Y. Liu, M. Xiao, M. Zhang, X. Li, M. Dong, Z. Ma, Z. Li, S. Chen, "Content-Adaptive Display Power Saving in Internet Mobile Streaming", Proc. of ACM NOSSDAV, Portland, OR, March 2015.

  • Maged Elkashlan, Zhan Ma, Yao Wang, Mohsen Guizani, Lei Shu, George K. Karagiannidis, Trung Q. Duong, "Green media: the future of wireless multimedia networks", IEEE Wireless Commun. vol. 21, no. 4, pp. 10-12, 2014.

  • Xiang Chen, Yiran Chen, Zhan Ma, and Felix C. A. Fernandes, "How is energy consumed in smartphone display applications", Proc. of ACM Hotmobile, Feb. 2013.

  • Xin Li, Zhan Ma and Felix. C. A. Fernandes, "Modeling Power Consumption for Video Decoding on Mobile Platform and Its Application to Power-Rate Constrained Streaming", Proc. of IEEE VCIP, San Diego, CA, Nov. 2012.

  • Xin Li, Mian Dong, Zhan Ma,and Felix C. A. Fernandes, "GreenTube: Power Optimization for Mobile Video Streaming via Dynamic Cache Management", Proc. of ACM Multimedia, Nara, Japan, Oct. 2012 .

  • Xin Li, Zhan Ma, and Felix C. A. Fernandes, “Unified complexity model for H.264/AVC video coding on mobile platform,” Proc. of IEEE ICIP, Orlando, FL, Sept. 2012

  • Zhan Ma, Felix C. A. Fernandes, and Yao Wang, “Power-Rate-Quality Optimized Scalable Video Adaptation,” Proc. of IEEE CISS, Princeton NJ, March. 2012

  • Zhan Ma, Hao Hu and Yao Wang, “On Complexity Modeling of H.264/AVC Video Decoding and Its Application for Energy Efficient Decoding,” IEEE Trans. Multimedia, vol. 13, no. 6, pp. 1240-1255, December 2011.

  • Zhan Ma and Andrew Segall, “Frame Buffer Compression for Low-power Video Coding,” Proc. of IEEE ICIP, Brussels, Belguim, Sept. 2011

  • Zhan Ma, Zhongbo Zhang and Yao Wang, “Complexity Modeling of H.264 Entropy Decoding,” Proc. of IEEE ICIP, San Diego, CA, Oct., 2008.

  • Zhan Ma and Yao Wang, “Complexity Modeling of SVC Decoding”, Proc. of IEEE ICASSP, Las Vegas, NV April 2008.

Standard Contributions

  • Zhan Ma, Felix Fernandes, Andrew Segall, Xavier Ducloux, “Draft requirements and discussion for Green MPEG,” ISO/IEC MPEG, Doc. M27770, Geneva, Switzerland, January 2013.

  • Zhan Ma, Felix Fernandes, Youngkwon Lim, Sungoh Hwang, Jaeyeon Song, Andrew Segall, “Draft requirements and discussion on Green MPEG,” ISO/IEC MPEG, Doc. m27060, Shanghai, China, October. 2012.

  • Zhan Ma, Felix Fernandes, Sungoh Hwang, Jaeyeon Song, Andrew Segall, Xavier Ducloux, Minhua Zhou, Justin Ridge, “Recommendation to Establish an AhG on Green MPEG,” ISO/IEC MPEG, Doc. m26399, Stockholm, SE, July. 2012.

  • Zhan Ma, Xin Li, Mian Dong, Felix Fernandes, Sungoh Hwang and Jaeyeon Song, “Embedding Content Information in Video Streams for Energy-efficient Video Processing on Mobile Devices,” ISO/IEC MPEG, Doc. m24982, Geneva, CH, April. 2012.

 

International Standard

  • ISO/IEC 23001-11