Abstract:
In this paper, we present a novel image acquisition framework capable of reconstructing high bit-depth images using an array of low bit-depth scalar quantizers. Our key c...Show MoreMetadata
Abstract:
In this paper, we present a novel image acquisition framework capable of reconstructing high bit-depth images using an array of low bit-depth scalar quantizers. Our key contribution is a codesign of pixel quantization and reconstruction in image acquisition pipeline. Different from the traditional image acquisition scheme, where each pixel value is quantized and reconstructed independently, the proposed framework is designed based on the interpixel correlations in local image regions. The interpixel correlations imply that quantized pixel values of adjacent locations can be interpreted as multiple descriptions of a common pixel value. Because combining multiple descriptions leads to reduced uncertainty, a pixel value with higher bit depth can be reconstructed by exploiting the interpixel correlations. In this paper, we propose to inject an embedded quantization bias (EQB) to the prequantized image signal and feed the sum to scalar quantizers. Injecting EQB has the same effect as shifting the quantizers by different amounts at different pixel locations, driving the quantized values of adjacent pixels to form informative descriptions of a common pixel value. We present comprehensive studies on this framework, including the optimal design of the EQB signal, the reconstruction strategies for noisy input, and generalized assumptions on interpixel correlations. We show in the experiments that the proposed image acquisition framework significantly outperforms the competing methods and effectively improves the quality of the reconstructed images.
Published in: IEEE Transactions on Computational Imaging ( Volume: 5, Issue: 4, December 2019)
Funding Agency:

Department of Automation, Tsinghua University, Beijing, China
Pengfei Wan received the B.E. degree in electronic engineering and information science from the University of Science and Technology of China, Hefei, China, and the Ph.D. degree in electronic and computer engineering from the Hong Kong University of Science and Technology, Hong Kong. His research interests include image/video signal processing, computational photography, and computer vision.
Pengfei Wan received the B.E. degree in electronic engineering and information science from the University of Science and Technology of China, Hefei, China, and the Ph.D. degree in electronic and computer engineering from the Hong Kong University of Science and Technology, Hong Kong. His research interests include image/video signal processing, computational photography, and computer vision.View more

Department of Automation, Tsinghua University, Beijing, China
Jiexiang Tan received the B.S. degree in automation in 2018 from Tsinghua University, Beijing, China, where he is currently working toward the master's degree with the Department of Automation. His research interests include image processing, computer vision, and computational photography.
Jiexiang Tan received the B.S. degree in automation in 2018 from Tsinghua University, Beijing, China, where he is currently working toward the master's degree with the Department of Automation. His research interests include image processing, computer vision, and computational photography.View more

Department of Automation, Tsinghua University, Beijing, China
Xiaocong Lian (S’15–M’17) received the B.S. and Ph.D. degrees in electronic science and technology from Northwestern Polytechnical University, Xi’an, China, in 2013 and 2017, respectively. He is currently a Postdoctoral Researcher with the Department of Automation, Tsinghua University, Beijing, China. His research interests include algorithms and very large scale integration implementation for video coding, and hardware a...Show More
Xiaocong Lian (S’15–M’17) received the B.S. and Ph.D. degrees in electronic science and technology from Northwestern Polytechnical University, Xi’an, China, in 2013 and 2017, respectively. He is currently a Postdoctoral Researcher with the Department of Automation, Tsinghua University, Beijing, China. His research interests include algorithms and very large scale integration implementation for video coding, and hardware a...View more

Department of Automation, Tsinghua University, Beijing, China
Xiangyang Ji (M’10) received the B.S. degree in materials science and the M.S. degree in computer science from the Harbin Institute of Technology, Harbin, China, in 1999 and 2001, respectively, and the Ph.D. degree in computer science from the Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China.
In 2008, he joined Tsinghua University, Beijing, where he is currently a Professor with the Department...Show More
Xiangyang Ji (M’10) received the B.S. degree in materials science and the M.S. degree in computer science from the Harbin Institute of Technology, Harbin, China, in 1999 and 2001, respectively, and the Ph.D. degree in computer science from the Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China.
In 2008, he joined Tsinghua University, Beijing, where he is currently a Professor with the Department...View more

Department of Automation, Tsinghua University, Beijing, China
Pengfei Wan received the B.E. degree in electronic engineering and information science from the University of Science and Technology of China, Hefei, China, and the Ph.D. degree in electronic and computer engineering from the Hong Kong University of Science and Technology, Hong Kong. His research interests include image/video signal processing, computational photography, and computer vision.
Pengfei Wan received the B.E. degree in electronic engineering and information science from the University of Science and Technology of China, Hefei, China, and the Ph.D. degree in electronic and computer engineering from the Hong Kong University of Science and Technology, Hong Kong. His research interests include image/video signal processing, computational photography, and computer vision.View more

Department of Automation, Tsinghua University, Beijing, China
Jiexiang Tan received the B.S. degree in automation in 2018 from Tsinghua University, Beijing, China, where he is currently working toward the master's degree with the Department of Automation. His research interests include image processing, computer vision, and computational photography.
Jiexiang Tan received the B.S. degree in automation in 2018 from Tsinghua University, Beijing, China, where he is currently working toward the master's degree with the Department of Automation. His research interests include image processing, computer vision, and computational photography.View more

Department of Automation, Tsinghua University, Beijing, China
Xiaocong Lian (S’15–M’17) received the B.S. and Ph.D. degrees in electronic science and technology from Northwestern Polytechnical University, Xi’an, China, in 2013 and 2017, respectively. He is currently a Postdoctoral Researcher with the Department of Automation, Tsinghua University, Beijing, China. His research interests include algorithms and very large scale integration implementation for video coding, and hardware acceleration of neural networks.
Xiaocong Lian (S’15–M’17) received the B.S. and Ph.D. degrees in electronic science and technology from Northwestern Polytechnical University, Xi’an, China, in 2013 and 2017, respectively. He is currently a Postdoctoral Researcher with the Department of Automation, Tsinghua University, Beijing, China. His research interests include algorithms and very large scale integration implementation for video coding, and hardware acceleration of neural networks.View more

Department of Automation, Tsinghua University, Beijing, China
Xiangyang Ji (M’10) received the B.S. degree in materials science and the M.S. degree in computer science from the Harbin Institute of Technology, Harbin, China, in 1999 and 2001, respectively, and the Ph.D. degree in computer science from the Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China.
In 2008, he joined Tsinghua University, Beijing, where he is currently a Professor with the Department of Automation, School of Information Science and Technology. He has authored more than 100 referred conference and journal papers. His current research interests include signal processing, image/video compression and communication, and intelligent imaging.
Xiangyang Ji (M’10) received the B.S. degree in materials science and the M.S. degree in computer science from the Harbin Institute of Technology, Harbin, China, in 1999 and 2001, respectively, and the Ph.D. degree in computer science from the Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China.
In 2008, he joined Tsinghua University, Beijing, where he is currently a Professor with the Department of Automation, School of Information Science and Technology. He has authored more than 100 referred conference and journal papers. His current research interests include signal processing, image/video compression and communication, and intelligent imaging.View more