Capsule Networks: Some Open Questions

KP Unnikrishnan1 We discuss some open questions in Capsule Networks and present potential modifications that can bring their architectures closer to that of mammalian sensory systems. This will lead to better efficacy. INTRODUCTION Perception includes identification, recognition, and tracking of objects within a scene; it may also involve the integration of information across modalities.2 The mechanics of perception reduce ambiguity and can be viewed as minimization of entropy (Hinton, Sejnowski, 1983; Harth, Pandya, Unnikrishnan, 1986). Read more…

Neuroscience Can Help AI

At eNeuroLearn, we will occasionally blog on aspects of Neuroscience, AI, and matters in between. These blogs are aimed at practitioners of Machine Learning, Deep Learning, and AI.  This post briefly introduces some unique aspects of mammalian sensory systems that are relevant to AI. These include: 1) Hierarchy; 2) Feedback; 3) Generic architecture; and 4) Sensory integration. Of these, hierarchy and the generic architecture are used in deep learning (DL) architectures. We point out how Read more…