Parallel Computing and Programming

This book introduces the parallel paradigm, and shows how parallel programming is carried out using a variety of programming languages. Foster details actual applications examples from engineering, science, and finance while keeping the focus throughout on parallel programming as opposed to algorithm development.

A clear illustration of how parallel computers can be successfully applied to large-scale scientific computations. This book demonstrates how a variety of applications in physics, biology, mathematics and other sciences were implemented on real parallel computers to produce new scientific results.

This book provides an advanced guide to the issues of the parallel and multithreaded programming. It goes beyond the high-level design of the applications, into the details that are often overlooked but vital to make the programs work. The content is oriented towards the programming of the operating systems, servers and business applications.

Since its release in summer 1994, the Message Passing Interface (MPI) specification has become a standard for message-passing libraries for parallel computations. There exist more than a dozen implementations on a variety of computing platforms, from the IBM SP-2 supercomputer to PCs running Windows NT.

An overview of practical parallel computing and principles will enable the reader to design efficient parallel programs for solving various computational problems on state-of-the-art personal computers and computing clusters.

The purpose of this book is to help you understand how to program shared-memory parallel machines without risking your sanity. By describing the algorithms and designs that have worked well in the past, we hope tohelp you avoid at least some of the pitfalls that have beset parallel projects. But you should think of this book as a foundation on which to build, rather than as a completed cathedral.

This book takes the reader on a tour of the fast-growing area of high performance computing and the optimization of hybrid programs, focuses on optimization for clusters consisting of the Intel Xeon processor.

Parallel machines provide a wonderful opportunity for applications with large computational requirements. Effeective use of these machines, though, requires a keen understanding of how they work. In only a few years, many standard software products will be based on concepts of parallel programming implemented on such hardware, and the range of applications will be much broader than that of scientific computing, up to now the main application area for parallel computing.

This book is intended for anyone who has heard about the many benefits of using HPC (such as streamlining processes or saving money). This book explains what HPC is and shows how it can help you or others within your company.

This book is devoted to the investigation of a special topic in theoretical computer science - Parallel Computing and Programming as an abstract measure of the complexity of parallel computing problems.

XcalableMP is a directive-based parallel programming language based on Fortran and C, supporting a Partitioned Global Address Space (PGAS) model for distributed memory parallel systems. This open access book presents XcalableMP language from its programming model and basic concept to the experience and performance of applications described in XcalableMP.