Smart IDReader: Document Recognition in Video Stream

This work is devoted to an identity document recognition system design for use in mobile phones and tablets using the computational capabilities of the device itself. Key differences are discussed in relation to conservative cloud recognition systems which commonly use single images as an input by design. A mobile recognition system chart is presented which is constructed with computational limitations in mind and which is implemented in a commercial solution. An original approach designed to improve recognition precision and reliability using post-OCR results integration in video stream, as opposed to approaches which rely on frame image integration using "super-resolution" algorithms. An interactive feedback between the system and its operator is discussed, such as automatic video stream recognition stopping decision. Experimental results are presented for an implemented commercial system "Smart IDReader" designed for identity documents recognition.

I. Introduction

Automatic recognition of digitized documents is a traditional function of modern document processing systems. By “recognition” a complicated iterative process is generally meant, which includes different algorithms of segmentation, classification and linguistic analysis.