Handwritten Digit Classification using 8-bit Floating Point based Convolutional Neural Networks

Michal Gallus, Alberto Nannarelli (Supervisor)

Research output: Book/ReportReport

1333 Downloads (Pure)

Abstract

Training of deep neural networks is often constrained by the available memory and computational power. This often causes it to run for weeks even when the underlying platform is employed with multiple GPUs. In order to speed up the training and reduce space complexity the paper presents an approach of using reduced precision (8-bit) floating points for training hand-written characters classifier LeNeT-5 which allows for achieving 97.10% (Top-1 and Top-5) accuracy while reducing the overall space complexity by 75% in comparison to a model using single precision floating points.
Original languageEnglish
PublisherDTU Compute
Number of pages4
Publication statusPublished - 2018
SeriesDTU Compute Technical Report-2018
Volume01

Keywords

  • Approximate computing
  • Deep learning

Fingerprint

Dive into the research topics of 'Handwritten Digit Classification using 8-bit Floating Point based Convolutional Neural Networks'. Together they form a unique fingerprint.

Cite this