Parallel and distributed computing : a survey of models, paradigms, and approaches / Claudia Leopold.

Format:

Book

Author/Creator:

Leopold, Claudia, 1966-

Contributor:

Isaac Norris Library Fund.

Series:

Wiley series on parallel and distributed computing

Language:

English

Subjects (All):

Parallel processing (Electronic computers).

Electronic data processing--Distributed processing.

Electronic data processing.

Physical Description:

xi, 260 pages : illustrations ; 25 cm.

Place of Publication:

New York : Wiley, 2001.

Summary:

The use of parallel and distributed computing has risen dramatically in the past few years, giving rise to a variety of projects, implementations and buzzwords surrounding the subject. Dr. Leopold provides a survey of the different methodologies currently used in constructing parallel and distributed systems, at an introductory level. This "compare and contrast" approach is supplemented by using specific projects and languages to illustrate key concepts.

Contents:

1.1 Parallel and Distributed Computing 1

1.2 Motivation for Parallel and Distributed Computing 6

1.3 Key Characteristics 8

1.4 Models and Paradigms 19

2 Architectures 31

2.1 SIMD Computers 31

2.2 Symmetric Multiprocessors 33

2.3 Cache-Coherent NUMA Architectures 35

2.4 Distributed-Memory Parallel Computers 37

2.5 Computer Networks and Protocols 38

2.6 Clusters 45

2.7 Loosely Coupled Distributed Systems and Grids 47

3 Data Parallelism 51

3.1 SIMD Parallelism 53

3.2 Data Parallelism on Arrays 56

3.3 Nested Data Parallelism 64

3.4 Collective Operations and Libraries 65

4 Shared-Memory Programming 73

4.1 Thread Models 76

4.2 Structured Shared-Memory Programming 84

4.3 Distributed Shared Memory 89

4.4 One-Sided Communication Models 92

5 Message Passing 95

5.1 Interprocess Communication 100

5.2 Task Management 103

5.3 Interoperability 105

5.4 Very Low-Level Models 106

5.5 More on This Topic 108

6 Client/Server Computing 111

6.1 The Client/Server Paradigm 113

6.2 Sockets 118

6.3 Remote Procedure Calls 122

7 Code Mobility 127

7.1 Enhanced Client/Server Computing 132

7.2 Mobile Agents 135

7.3 Parallel Mobile Code 139

7.4 Transparent Migration 142

7.5 More on This Topic 143

8 Coordination Models 145

8.1 Tuple-Based Coordination 146

8.2 Channel-Based Coordination 151

9 Object-Oriented Models 157

9.1 Distributed Objects 159

9.2 Active Objects 167

10 High-Level Programming Models 177

10.1 Automatic Parallelization 177

10.2 Skeleton Models 182

10.3 Compositional Models 186

10.4 Functional Programming Models 189

10.5 Logic Programming Models 193

11 Abstract Models 199

11.1 Network Models 201

11.2 Parallel Random-Access Machine 205

11.3 Bulk-Synchronous Parallel Model 209

11.4 The LogP and QSM Models 214

11.5 Locality-Centric Models 216

11.6 Graph-Based Models 219

12 Final Comparison 223.

Notes:

"A Wiley-Interscience publication."

Includes bibliographical references (pages 229-254) and index.

Local Notes:

Acquired for the Penn Libraries with assistance from the Isaac Norris Library Fund.

ISBN:

0471358312

OCLC:

45172644