For Full-Text PDF, please login, if you are a member of IEICE,|
or go to Pay Per View on menu list, if you are a nonmember of IEICE.
Exploiting Sparse Activation for Low-Power Design of Synchronous Neuromorphic Systems
Jaeyong CHUNG Woochul KANG
IEICE TRANSACTIONS on Electronics
Publication Date: 2017/11/01
Online ISSN: 1745-1353
Type of Manuscript: BRIEF PAPER
Category: Integrated Electronics
neuromorphic systems, VLSI design, computer-aided design,
Full Text: PDF(322.5KB)
>>Buy this Article
Massive amounts of computation involved in real-time evaluation of deep neural networks pose a serious challenge in battery-powered systems, and neuromorphic systems specialized in neural networks have been developed. This paper first shows the portion of active neurons at a time dwindles as going toward the output layer in recent large-scale deep convolutional neural networks. Spike-based, asynchronous neuromorphic systems take advantage of the sparse activation and reduce dynamic power consumption, while synchronous systems may waste much dynamic power even for the sparse activation due to clocks. We thus propose a clock gating-based dynamic power reduction method that exploits the sparse activation for synchronous neuromorphic systems. We apply the proposed method to a building block of a recently proposed synchronous neuromorphic computing system and demonstrate up to 79% dynamic power saving at a negligible overhead.