Loading [MathJax]/extensions/MathZoom.js
Blind Denoising of Fluorescence Microscopy Images Using GAN-Based Global Noise Modeling | IEEE Conference Publication | IEEE Xplore

Blind Denoising of Fluorescence Microscopy Images Using GAN-Based Global Noise Modeling


Abstract:

Fluorescence microscopy is a key driving force behind advances in modern life sciences. However, due to constraints in image formation and acquisition, to obtain high sig...Show More

Abstract:

Fluorescence microscopy is a key driving force behind advances in modern life sciences. However, due to constraints in image formation and acquisition, to obtain high signal-to-noise ratio (SNR) fluorescence images remains difficult. Strong noise negatively affects not only visual observation but also downstream analysis. To address this problem, we propose a blind global noise modeling denoiser (GNMD) that simulates image noise globally using a generative adversarial network (GAN). No prior information on noise properties is required. And no clean training targets need to be provided for noisy inputs. Instead, by simulating real image noise using a GAN, our method synthesizes paired noisy and clean images for training a denoising deep learning network. Experiments on real fluorescence microscopy images show that our method substantially outperforms competing state-of-the-art methods, especially in suppressing background noise. Denoising using our method also facilitates downstream image segmentation.
Date of Conference: 13-16 April 2021
Date Added to IEEE Xplore: 25 May 2021
ISBN Information:

ISSN Information:

Conference Location: Nice, France

Funding Agency:

References is not available for this document.

1. Introduction

Fluorescence microscopy is a powerful tool for life sciences. But fluorescence microscopy images usually have low signal-to-noise ratio (SNR), which negatively affects visual observation and downstream analysis. Indeed, fluorescence images have much weaker signals than natural images [1]. Furthermore, natural images are affected primarily by Gaussian noise, whereas fluorescence images are also affected strongly by Poisson noise [2].

Select All
1.
P. A. Morris, R. S. Aspden, J. E. Bell, R. W. Boyd and M. J. Padgett, "Imaging with a small number of photons", Nature Communications, vol. 6, no. 1, pp. 1-6, 2015.
2.
Y. Zhang et al., "A Poisson-Gaussian denoising dataset with real fluorescence microscopy images", CVPR, pp. 11710-11718, 2019.
3.
L. Shao, R. Yan, X. Li and Y. Liu, "From heuristic optimization to dictionary learning: A review and comprehensive comparison of image denoising algorithms", IEEE Trans Cybern, vol. 44, no. 7, pp. 1001-1013, 2013.
4.
R. S. Thakur, R. N. Yadav and L. Gupta, "State-of-art analysis of image denoising methods using convolutional neural networks", IET Image Process, vol. 13, no. 13, pp. 2367-2380, 2019.
5.
K. Zhang, W. Zuo, Y. Chen, D. Meng and L. Zhang, "Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising", IEEE Trans Image Process, vol. 26, no. 7, pp. 3142-3155, 2017.
6.
V. Jain and H. S. Seung, "Natural image denoising with convolutional networks", NeurIPS, pp. 769-776, 2008.
7.
T. Brooks, B. Mildenhall, T. Xue, J. Chen, D. Sharlet and J. T. Barron, "Unprocessing images for learned raw denoising", CVPR, pp. 11036-11045, 2019.
8.
M. Makitalo and A. Foi, "Optimal inversion of the generalized Anscombe transformation for Poisson-Gaussian noise", IEEE Trans Image Process, vol. 22, no. 1, pp. 91-103, 2012.
9.
A. Foi, M. Trimeche, V. Katkovnik and K. Egiazarian, "Practical Poissonian-Gaussian noise modeling and fitting for single-image raw-data", IEEE Trans Image Process, vol. 17, no. 10, pp. 1737-1754, 2008.
10.
K. Dabov, A. Foi, V. Katkovnik and K. Egiazarian, "Image denoising by sparse 3-D transform-domain collaborative filtering", IEEE Trans Image Process, vol. 16, no. 8, pp. 2080-2095, 2007.
11.
A. Buades, B. Coll and J. M. Morel, "A non-local algorithm for image denoising", CVPR, pp. 60-65, 2005.
12.
S. Haider et al., "Fluorescence microscopy image noise reduction using a stochastically-connected random field model", Scientific Reports, vol. 6, pp. 20640, 2016.
13.
M. Aharon, M. Elad and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation", IEEE Trans Signal Process, vol. 54, no. 11, pp. 4311-4322, 2006.
14.
F. Luisier, T. Blu and M. Unser, "Image denoising in mixed Poisson–Gaussian noise", IEEE Trans Image Process, vol. 20, no. 3, pp. 696-708, 2011.
15.
C.-A. Deledalle, F. Tupin and L. Denis, "Poisson NL means: Unsupervised non local means for Poisson noise", ICIP, pp. 801-804, 2010.
16.
X. Mao, C. Shen and Y.-B. Yang, "Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections", NeurIPS, pp. 2802-2810, 2016.
17.
M. Weigert et al., "Content-aware image restoration: pushing the limits of fluorescence microscopy", Nature Methods, vol. 15, no. 12, pp. 1090-1097, 2018.
18.
J. Lehtinen et al., "Noise2noise: Learning image restoration without clean data", ICML, pp. 2965-2974, 2018.
19.
T. Bepler, A. J. Noble and B. Berger, "Topaz-Denoise: general deep denoising models for cryoEM", bioRxiv, pp. 838920, 2019.
20.
J. Batson and L. Royer, "Noise2self: Blind denoising by self-supervision", ICML, pp. 524-533, 2019.
21.
I. Goodfellow et al., "Generative adversarial nets", NeurIPS, pp. 2672-2680, 2014.
22.
P. Isola, J.-Y. Zhu, T. Zhou and A. A. Efros, "Image-to-image translation with conditional adversarial networks", CVPR, pp. 1125-1134, 2017.
23.
S.-H. Cha, "Comprehensive survey on distance/similarity measures between probability density functions", International Journal of Mathematical Models and Methods in Applied Sciences, vol. 1, no. 4, pp. 300-307, 2007.
24.
J. Chen, J. Chen, H. Chao and M. Yang, "Image blind denoising with generative adversarial network based noise modeling", CVPR, pp. 3155-3164, 2018.
25.
X. Chai, Q. Ba and G. Yang, "Characterizing robustness and sensitivity of convolutional neural networks for quantitative analysis of mitochondrial morphology", Quantitative Biology, vol. 6, no. 4, pp. 344-358, 2018.
26.
K. He, X. Zhang, S. Ren and J. Sun, "Deep residual learning for image recognition", CVPR, pp. 770-778, 2016.
27.
K.-C. J. Chen, Y. Yu, R. Li, H.-C. Lee, G. Yang and J. Kovačević, "Adaptive active-mask image segmentation for quantitative characterization of mitochondrial morphology", ICIP, pp. 2033-2036, 2012.
28.
J.-F. Aujol and A. Chambolle, "Dual norms and image decomposition models", International Journal of Computer Vision, vol. 63, no. 1, pp. 85-104, 2005.

Contact IEEE to Subscribe

References

References is not available for this document.