Keyword : activation function


Global Hyperbolic Hopfield Neural Networks
Masaki KOBAYASHI 
Publication:   IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences
Publication Date: 2016/12/01
Vol. E99-A  No. 12 ; pp. 2511-2516
Type of Manuscript:  PAPER
Category: Nonlinear Problems
Keyword: 
Hopfield neural networkshyperbolic numberClifford algebraactivation function
 Summary | Full Text:PDF

Speeding up Deep Neural Networks in Speech Recognition with Piecewise Quantized Sigmoidal Activation Function
Anhao XING Qingwei ZHAO Yonghong YAN 
Publication:   IEICE TRANSACTIONS on Information and Systems
Publication Date: 2016/10/01
Vol. E99-D  No. 10 ; pp. 2558-2561
Type of Manuscript:  Special Section LETTER (Special Section on Recent Advances in Machine Learning for Spoken Language Processing)
Category: Acoustic modeling
Keyword: 
deep neural networksspeech recognitionactivation functionfixed-point quantization
 Summary | Full Text:PDF

Uniqueness Theorem of Complex-Valued Neural Networks with Polar-Represented Activation Function
Masaki KOBAYASHI 
Publication:   IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences
Publication Date: 2015/09/01
Vol. E98-A  No. 9 ; pp. 1937-1943
Type of Manuscript:  PAPER
Category: Nonlinear Problems
Keyword: 
complex-valued neural networksactivation functionreducibilityuniqueness theorem
 Summary | Full Text:PDF

Design of Sigmoid Activation Functions for Fuzzy Cognitive Maps via Lyapunov Stability Analysis
In Keun LEE Soon Hak KWON 
Publication:   IEICE TRANSACTIONS on Information and Systems
Publication Date: 2010/10/01
Vol. E93-D  No. 10 ; pp. 2883-2886
Type of Manuscript:  LETTER
Category: Biocybernetics, Neurocomputing
Keyword: 
activation functionLyapunov stability analysisfuzzy cognitive map
 Summary | Full Text:PDF

Arctangent Activation Function to Accelerate Backpropagation Learning
Joarder KAMRUZZAMAN 
Publication:   IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences
Publication Date: 2002/10/01
Vol. E85-A  No. 10 ; pp. 2373-2376
Type of Manuscript:  LETTER
Category: Neural Networks and Bioengineering
Keyword: 
neural networkbackpropagation learningactivation functionlearning speed
 Summary | Full Text:PDF

Comparison of Convergence Behavior and Generalization Ability in Backpropagation Learning with Linear and Sigmoid Output Units
Joarder KAMRUZZAMAN Yukio KUMAGAI Hiromitsu HIKITA 
Publication:   IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences
Publication Date: 1993/06/25
Vol. E76-A  No. 6 ; pp. 1035-1042
Type of Manuscript:  LETTER
Category: Neural Networks
Keyword: 
backpropagation algorithmactivation functionlog-likelihood cost functionconvergence behaviorgeneralization ability
 Summary | Full Text:PDF