Exploiting Sparse Activation for Low-Power Design of Synchronous Neuromorphic Systems

Jaeyong CHUNG  Woochul KANG  

Publication
IEICE TRANSACTIONS on Electronics   Vol.E100-C   No.11   pp.1073-1076
Publication Date: 2017/11/01
Online ISSN: 1745-1353
Type of Manuscript: BRIEF PAPER
Category: Integrated Electronics
Keyword: 
neuromorphic systems,  VLSI design,  computer-aided design,  

Full Text: PDF(322.5KB)
>>Buy this Article


Summary: 
Massive amounts of computation involved in real-time evaluation of deep neural networks pose a serious challenge in battery-powered systems, and neuromorphic systems specialized in neural networks have been developed. This paper first shows the portion of active neurons at a time dwindles as going toward the output layer in recent large-scale deep convolutional neural networks. Spike-based, asynchronous neuromorphic systems take advantage of the sparse activation and reduce dynamic power consumption, while synchronous systems may waste much dynamic power even for the sparse activation due to clocks. We thus propose a clock gating-based dynamic power reduction method that exploits the sparse activation for synchronous neuromorphic systems. We apply the proposed method to a building block of a recently proposed synchronous neuromorphic computing system and demonstrate up to 79% dynamic power saving at a negligible overhead.