Supervised Machine Learning and Feature Selection for a Document Analysis Application

James Pope, Daniel Powers, J A (Jim) Connell, David Taylor, Xenofon Fafoutis

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

80 Downloads (Pure)

Abstract

Over the past three decades large amounts of information have been converted to image formats from paper documents. Though in digital form, extracting the information, usually textual, from these documents requires complex image processing and optical character recognition techniques. The processing pipeline from the image to information typically includes an orientation correction task, document identification task, and text analysis task. When there are many document variants the tasks become difficult requiring complex subanalysis for each variant and quickly exceeds human capability. In this work, we demonstrate a document
analysis application with the orientation correction and document identification task carried out by supervised machine learning techniques for a large, international airline. The documents have been amassed over forty years with numerous variants and are mostly black and white, typically consist of text and lines, and some
have extensive noise. Low level symbols are extracted from the raw images and separated into partitions. The partitions are used to generate statistical features which are then used to train the classifiers. We compare the classifiers for each task (e.g. decision tree, support vector machine, and random forest) to choose the most appropriate. We also perform feature selection to reduce the complexity of the document type classifiers. These parsimonious models result in comparable accuracy with 80% or fewer features.
Original languageEnglish
Title of host publicationProceedings of the 9th International Conference on Pattern Recognition Applications and Methods
PublisherSCITEPRESS Digital Library
Publication date2020
Pages415 - 424
ISBN (Print)978-989-758-397-1
DOIs
Publication statusPublished - 2020
Event9th International Conference on Pattern Recognition Applications and Methods - Valletta, Malta
Duration: 22 Feb 202024 Feb 2020

Conference

Conference9th International Conference on Pattern Recognition Applications and Methods
CountryMalta
CityValletta
Period22/02/202024/02/2020

Keywords

  • Document Analysi
  • Supervised Machine Learning
  • Feature Selection
  • Optical Character Recognition

Fingerprint Dive into the research topics of 'Supervised Machine Learning and Feature Selection for a Document Analysis Application'. Together they form a unique fingerprint.

Cite this