Deep Learning with TensorFlow - Second Edition / Zaccone, Giancarlo.

Format:

Book

Author/Creator:

Zaccone, Giancarlo, author.

Karim, Rezaul, author.

Language:

English

Subjects (All):

Machine learning.

Artificial intelligence.

Python (Computer program language).

Physical Description:

1 online resource (484 pages)

Edition:

2nd edition

Place of Publication:

Packt Publishing, 2018.

System Details:

text file

Biography/History:

Zaccone Giancarlo: Giancarlo Zaccone has over fifteen years' experience of managing research projects in the scientific and industrial domains. He is a software and systems engineer at the European Space Agency (ESTEC), where he mainly deals with the cybersecurity of satellite navigation systems. Giancarlo holds a master's degree in physics and an advanced master's degree in scientific computing. Giancarlo has already authored the following titles, available from Packt: Python Parallel Programming Cookbook (First Edition), Getting Started with TensorFlow, Deep Learning with TensorFlow (First Edition), and Deep Learning with TensorFlow (Second Edition). Karim Md. Rezaul: Md. Rezaul Karim is a researcher, author, and data science enthusiast with a strong computer science background, coupled with 10 years of research and development experience in machine learning, deep learning, and data mining algorithms to solve emerging bioinformatics research problems by making them explainable. He is passionate about applied machine learning, knowledge graphs, and explainable artificial intelligence (XAI). Currently, he is working as a research scientist at Fraunhofer FIT, Germany. He is also a PhD candidate at RWTH Aachen University, Germany. Before joining FIT, he worked as a researcher at the Insight Centre for Data Analytics, Ireland. Previously, he worked as a lead software engineer at Samsung Electronics, Korea.

Summary:

Delve into neural networks, implement deep learning algorithms, and explore layers of data abstraction with the help of TensorFlow. About This Book Learn how to implement advanced techniques in deep learning with Google's brainchild, TensorFlow Explore deep neural networks and layers of data abstraction with the help of this comprehensive guide Gain real-world contextualization through some deep learning problems concerning research and application Who This Book Is For The book is for people interested in machine learning and machine intelligence. A rudimentary level of programming in one language is assumed, as is a basic familiarity with computer science techniques and technologies, including a basic awareness of computer hardware and algorithms. Some competence in mathematics is needed to the level of elementary linear algebra and calculus. What You Will Learn Apply deep machine intelligence and GPU computing with TensorFlow Access public datasets and use TensorFlow to load, process, and transform the data Discover how to use the high-level TensorFlow API to build more powerful applications Use deep learning for scalable object detection and mobile computing Train machines quickly to learn from data by exploring reinforcement learning techniques Explore active areas of deep learning research and applications In Detail Deep learning is a branch of machine learning algorithms based on learning multiple levels of abstraction. Neural networks, which are at the core of deep learning, are being used in predictive analytics, computer vision, natural language processing, time series forecasting, and to perform a myriad of other complex tasks. This book is conceived for developers, data analysts, machine learning practitioners and deep learning enthusiasts who want to build powerful, robust, and accurate predictive models with the power of TensorFlow, combined with other open source Python libraries. Throughout the book, you’ll learn how to develop deep learning applications for machine learning systems using Feedforward Neural Networks, Convolutional Neural Networks, Recurrent Neural Networks, Autoencoders, and Factorization Machines. Discover how to attain deep learning programming on GPU in a distributed way. You'll come away with an in-depth knowledge of machine learning techniques and the skills to apply them to real-world projects. Style and approach This step-by-step guide explores common, and not so common, deep neural networks, and shows ho...

Contents:

Cover

Copyright

Packt Upsell

Contributors

Table of Contents

Preface

Chapter 1: Getting Started with Deep Learning

A soft introduction to machine learning

Supervised learning

Unbalanced data

Unsupervised learning

Reinforcement learning

What is deep learning?

Artificial neural networks

The biological neurons

The artificial neuron

How does an ANN learn?

ANNs and the backpropagation algorithm

Weight optimization

Stochastic gradient descent

Neural network architectures

Deep Neural Networks (DNNs)

Multilayer perceptron

Deep Belief Networks (DBNs)

Convolutional Neural Networks (CNNs)

AutoEncoders

Recurrent Neural Networks (RNNs)

Emergent architectures

Deep learning frameworks

Summary

Chapter 2: A First Look at TensorFlow

A general overview of TensorFlow

What's new in TensorFlow v1.6?

Nvidia GPU support optimized

Introducing TensorFlow Lite

Eager execution

Optimized Accelerated Linear Algebra (XLA)

Installing and configuring TensorFlow

TensorFlow computational graph

TensorFlow code structure

Eager execution with TensorFlow

Data model in TensorFlow

Tensor

Rank and shape

Data type

Variables

Fetches

Feeds and placeholders

Visualizing computations through TensorBoard

How does TensorBoard work?

Linear regression and beyond

Linear regression revisited for a real dataset

Chapter 3: Feed-Forward Neural Networks with TensorFlow

Feed-forward neural networks (FFNNs)

Feed-forward and backpropagation

Weights and biases

Activation functions

Using sigmoid

Using tanh

Using ReLU

Using softmax

Implementing a feed-forward neural network

Exploring the MNIST dataset

Softmax classifier

Implementing a multilayer perceptron (MLP)

Training an MLP

Using MLPs.

Dataset description

Preprocessing

A TensorFlow implementation of MLP for client-subscription assessment

Restricted Boltzmann Machines (RBMs)

Construction of a simple DBN

Unsupervised pre-training

Supervised fine-tuning

Implementing a DBN with TensorFlow for client-subscription assessment

Tuning hyperparameters and advanced FFNNs

Tuning FFNN hyperparameters

Number of hidden layers

Number of neurons per hidden layer

Weight and biases initialization

Selecting the most suitable optimizer

GridSearch and randomized search for hyperparameters tuning

Regularization

Dropout optimization

Chapter 4: Convolutional Neural Networks

Main concepts of CNNs

CNNs in action

LeNet5

Implementing a LeNet-5 step by step

AlexNet

Transfer learning

Pretrained AlexNet

Dataset preparation

Fine-tuning implementation

VGG

Artistic style learning with VGG-19

Input images

Content extractor and loss

Style extractor and loss

Merger and total loss

Training

Inception-v3

Exploring Inception with TensorFlow

Emotion recognition with CNNs

Testing the model on your own image

Source code

Chapter 5: Optimizing TensorFlow Autoencoders

How does an autoencoder work?

Implementing autoencoders with TensorFlow

Improving autoencoder robustness

Implementing a denoising autoencoder

Implementing a convolutional autoencoder

Encoder

Decoder

Fraud analytics with autoencoders

Description of the dataset

Problem description

Exploratory data analysis

Training, validation, and testing set preparation

Normalization

Autoencoder as an unsupervised feature learning algorithm

Evaluating the model

Chapter 6: Recurrent Neural Networks

Working principles of RNNs.

Implementing basic RNNs in TensorFlow

RNN and the long-term dependency problem

Bi-directional RNNs

RNN and the gradient vanishing-exploding problem

LSTM networks

GRU cell

Implementing an RNN for spam prediction

Data description and preprocessing

Developing a predictive model for time series data

Pre-processing and exploratory analysis

LSTM predictive model

Model evaluation

An LSTM predictive model for sentiment analysis

Network design

LSTM model training

Visualizing through TensorBoard

LSTM model evaluation

Human activity recognition using LSTM model

Dataset description

Workflow of the LSTM model for HAR

Implementing an LSTM model for HAR

Chapter 7: Heterogeneous and Distributed Computing

GPGPU computing

The GPGPU history

The CUDA architecture

The GPU programming model

The TensorFlow GPU setup

Update TensorFlow

GPU representation

Using a GPU

GPU memory management

Assigning a single GPU on a multi-GPU system

The source code for GPU with soft placement

Using multiple GPUs

Distributed computing

Model parallelism

Data parallelism

The distributed TensorFlow setup

Chapter 8: Advanced TensorFlow Programming

tf.estimator

Estimators

Graph actions

Parsing resources

Flower predictions

TFLearn

Installation

Titanic survival predictor

PrettyTensor

Chaining layers

Normal mode

Sequential mode

Branch and join

Digit classifier

Keras

Keras programming models

Sequential model

Functional API

Chapter 9: Recommendation Systems Using Factorization Machines

Recommendation systems

Collaborative filtering approaches

Content-based filtering approaches

Hybrid recommender systems

Model-based collaborative filtering.

Movie recommendation using collaborative filtering

The utility matrix

Ratings data

Movies data

Users data

Exploratory analysis of the MovieLens dataset

Implementing a movie RE

Training the model with the available ratings

Inferencing the saved model

Generating the user-item table

Clustering similar movies

Movie rating prediction by users

Finding top k movies

Predicting top k similar movies

Computing user-user similarity

Evaluating the recommender system

Factorization machines for recommendation systems

Factorization machines

Cold-start problem and collaborative-filtering approaches

Problem definition and formulation

Workflow of the implementation

Training the FM model

Improved factorization machines

Neural factorization machines

Using NFM for the movie recommendation

Chapter 10: Reinforcement Learning

The RL problem

OpenAI Gym

OpenAI environments

The env class

Installing and running OpenAI Gym

The Q-Learning algorithm

The FrozenLake environment

Deep Q-learning

Deep Q neural networks

The Cart-Pole problem

Deep Q-Network for the Cart-Pole problem

The Experience Replay method

Exploitation and exploration

The Deep Q-Learning training algorithm

Other Books You May Enjoy

Leave a review - let other readers know what you think

Index.

Notes:

Includes index.

Online resource; Title from title page (viewed March 30, 2018)

ISBN:

1-78883-183-7

OCLC:

1035160358