Loading [MathJax]/extensions/MathZoom.js
Electronically Foveated Dynamic Vision Sensor | IEEE Conference Publication | IEEE Xplore

Electronically Foveated Dynamic Vision Sensor


Abstract:

This paper proposed a vision system which implements a foveal mechanism to concentrate the attention and dynamically control the center and size of region of interest. Th...Show More

Abstract:

This paper proposed a vision system which implements a foveal mechanism to concentrate the attention and dynamically control the center and size of region of interest. The core of the system is an electronically-foveated dynamic vision sensor. An architecture and implementation of an electronically-foveated dynamic vision sensor is proposed. Simulation results demonstrating its operation are provided.
Date of Conference: 01-03 August 2022
Date Added to IEEE Xplore: 18 August 2022
ISBN Information:
Conference Location: Barcelona, Spain

Funding Agency:

References is not available for this document.

I. Introduction

Conventional vision sensors are based in the acquisition of frames. A conventional pixel in a photograph or video camera integrates the light impinging on the pixel during a subperiod (integration time) of a periodic acquisition time called frame (normally in the order of 20-30ms). Each frame period the sensor will deliver a complete acquired image. When a stimulus moves in the observed scene with a relative speed which is low compared with the periodic frame time, which is normally the case of static background and slow moving parts, the acquired image is very similar from frame to frame containing a lot of redundant information. On the contrary, when a stimulus moves in the observed scene with a relative speed which is high relative to the integration period the object will appear as moved in the acquired image.

Select All
1.
M. Mahowald, "VLSI Analogs of Neuronal Visual Processing: A Synthesis of Form and Function", Technology, vol. 1992, no. May, pp. 236, 1992.
2.
C. Posch, T. Serrano-Gotarredona, B. Linares-Barranco and T. Delbruck, "Retinomorphic event-based vision sensors: Bioinspired cameras with spiking output", Proc. IEEE, vol. 102, no. 10, pp. 1470-1484, 2014.
3.
P. Lichtsteiner, C. Posch and T. Delbruck, "A 128x128 120 dB 15 us latency asynchronous temporal contrast vision sensor", IEEE J. Solid-State Circuits, vol. 43, no. 2, pp. 566-576, 2008.
4.
C. Li, L. Longinotti, F. Corradi and T. Delbruck, "A 132 by 104 10µm-Pixel 250µW 1kefps Dynamic Vision Sensor with Pixel-Parallel Noise and Spatial Redundancy Suppression", 2019 Symp. VLSI Circuits, vol. 2, pp. C216-C217, 2019.
5.
T. Finateu et al., "A 1280×720 Back-Illuminated Stacked Temporal Contrast Event-Based Vision Sensor with 4.86µm Pixels 1.066GEPS Readout Programmable Event-Rate Controller and Compressive Data-Formatting Pipeline", Digest of Technical Papers - IEEE International Solid-State Circuits Conference, vol. 2020-Febru, pp. 112-114, 2020.
6.
T. Shibata, S. Vijayakumar, J. Conradt and S. Schaal, "Biomimetic oculomotor control", Adapt. Behav., vol. 9, no. 3–4, pp. 189-207, 2001.
7.
A. Ude, C. Gaskett and G. Cheng, "Foveated vision systems with two cameras per eye", Proc. - IEEE Int. Conf. Robot. Autom., vol. 2006, no. May, pp. 3457-3462, 2006.
8.
M. Azadmehr, J. P. Abrahamsen and P. Hafliger, "A Foveated AER Imager Chip", Int Symp. Circuits Syst, pp. 2751-2754, 2005.
9.
S. Xia, R. Sridhar, P. Scott and C. Bandera, "All CMOS foveal image sensor chip", Proc. Annu. IEEE Int. ASIC Conf. Exhib., pp. 409-413, 1998.
10.
R. Wodnicki, G. W. Roberts and M. D. Levine, "A log-polar image sensor fabricated in a standard 1.2-µm ASIC CMOS process", IEEE J. Solid-State Circuits, vol. 32, no. 8, pp. 1274-1277, 1997.
11.
R. Etienne-Cummings, J. Der Van Spiegel, P. Mueller and M. Z. Zhang, "A foveated silicon retina for two-dimensional tracking", IEEE Trans. Circuits Syst. II Analog Digit. Signal Process., vol. 47, no. 6, pp. 504-517, 2000.
12.
T. G. Constandinou, P. Degenaar and C. Toumazou, "An adaptable foveating vision chip", Proc. - IEEE Int. Symp. Circuits Syst., pp. 3566-3569, 2006.
13.
T. Serrano-Gotarredona and B. Linares-Barranco, "sensor de visión dinámico foveado electrónicamente", 2021.
14.
T. Serrano-Gotarredona and B. Linares-Barranco, "A 128× 128 1.5% contrast sensitivity 0.9% FPN 3 µs latency 4 mW asynchronous frame-free dynamic vision sensor using transimpedance preamplifiers", IEEE J. Solid-State Circuits, vol. 48, no. 3, pp. 827-838, 2013.

Contact IEEE to Subscribe

References

References is not available for this document.