Tampere University of Technology

TUTCRIS Research Portal

Binarized Convolutional Neural Networks for Efficient Inference on GPUs

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review


Original languageEnglish
Title of host publication2018 26th European Signal Processing Conference (EUSIPCO)
ISBN (Electronic)978-9-0827-9701-5
ISBN (Print)978-1-5386-3736-4
Publication statusPublished - Sep 2018
Publication typeA4 Article in a conference publication
EventEuropean Signal Processing Conference -
Duration: 1 Jan 1900 → …

Publication series

ISSN (Electronic)2076-1465


ConferenceEuropean Signal Processing Conference
Period1/01/00 → …


Convolutional neural networks have recently achieved significant breakthroughs in various image classification tasks. However, they are computationally expensive, which can make their feasible implementation on embedded and low-power devices difficult. In this paper convolutional neural network binarization is implemented on GPU-based platforms for real-time inference on resource constrained devices. In binarized networks, all weights and intermediate computations between layers are quantized to +1 and -1, allowing multiplications and additions to be replaced with bit-wise operations between 32-bit words. This representation completely eliminates the need for floating point multiplications and additions and decreases both the computational load and the memory footprint compared to a full-precision network implemented in floating point, making it well-suited for resource-constrained environments. We compare the performance of our implementation with an equivalent floating point implementation on one desktop and two embedded GPU platforms. Our implementation achieves a maximum speed up of 7.4× with only 4.4 % loss in accuracy compared to a reference implementation.

Publication forum classification

Field of science, Statistics Finland