Space-Time Computing with Temporal Neural Networks / by James E. Smith.

Format:

Book

Author/Creator:

Smith, James E., Author.

Series:

Synthesis Lectures on Computer Architecture, 1935-3243

Language:

English

Subjects (All):

Electronic circuits.

Microprocessors.

Computer architecture.

Electronic Circuits and Systems.

Processor Architectures.

Local Subjects:

Electronic Circuits and Systems.

Processor Architectures.

Physical Description:

1 online resource (XXIV, 220 p.)

Edition:

1st ed. 2017.

Place of Publication:

Cham : Springer International Publishing : Imprint: Springer, 2017.

Summary:

Understanding and implementing the brain's computational paradigm is the one true grand challenge facing computer researchers. Not only are the brain's computational capabilities far beyond those of conventional computers, its energy efficiency is truly remarkable. This book, written from the perspective of a computer designer and targeted at computer researchers, is intended to give both background and lay out a course of action for studying the brain's computational paradigm. It contains a mix of concepts and ideas drawn from computational neuroscience, combined with those of the author. As background, relevant biological features are described in terms of their computational and communication properties. The brain's neocortex is constructed of massively interconnected neurons that compute and communicate via voltage spikes, and a strong argument can be made that precise spike timing is an essential element of the paradigm. Drawing from the biological features, a mathematics-based computational paradigm is constructed. The key feature is spiking neurons that perform communication and processing in space-time, with emphasis on time. In these paradigms, time is used as a freely available resource for both communication and computation. Neuron models are first discussed in general, and one is chosen for detailed development. Using the model, single-neuron computation is first explored. Neuron inputs are encoded as spike patterns, and the neuron is trained to identify input pattern similarities. Individual neurons are building blocks for constructing larger ensembles, referred to as "columns". These columns are trained in an unsupervised manner and operate collectively to perform the basic cognitive function of pattern clustering. Similar input patterns are mapped to a much smaller set of similar output patterns, thereby dividing the input patterns into identifiable clusters. Larger cognitive systems are formed by combining columns into a hierarchical architecture. These higher level architectures are the subject of ongoing study, and progress to date is described in detail in later chapters. Simulation plays a major role in model development, and the simulation infrastructure developed by the author is described.

Contents:

Preface

Acknowledgments

Introduction

Space-Time Computing

Biological Overview

Connecting TNNs with Biology

Neuron Modeling

Computing with Excitatory Neurons

System Architecture

Simulator Implementation

Clustering the MNIST Dataset

Summary and Conclusions

References

Author Biography.

ISBN:

9783031017544

3031017544