Handwritten Prescription Recognition Using VGG Based Architecture with Bi-LSTM

Illegible handwriting on medical prescriptions poses a significant challenge, often leading to the misinterpretation of drug names and dosages. This issue primarily stems from doctors’ use of Latin abbreviations, driven by time constraints during patient consultations. The resultant discrepancies in prescription interpretation can potentially expose patients to incorrect medications and dosages, leading to adverse effects. In response to this concern, this study proposes a novel system integrating Convolution Neural Network (CNN) and Recurrent Neural Network (RNN) models. Promising findings are reported in this study, achieving a loss of 0.4874 and an accuracy of 0.83 in the latest trial. The final model offers a potential solution to the persistent problem of illegible prescriptions, enhancing patient safety in the healthcare domain.