I just uploaded another paper on Parallel Computing . This time I implemented parallel algorithm in the backward Substitution portion of the Gaussian ELimination algorithm to solve Systems of Linear Equations. I used C++ and the MPI Library from the Microsoft Compute Cluster Pack that is part of Microsoft...

As promised in my earlier post , here I'd like to talk about Amdahl's Law , thru which you'll get the formal idea that speed up by parallelism only really works for certain kind of problems. Problems which algorithms to solve have small serial fractions. My goal with this post is to give...

Let say it takes 6 minutes to do a computation on a set of data in a single processor. Then you have 3 processors altogether. Would your task finish in 2 minutes (6 divided by 3)? NO IT WON'T! Why? Because your algorithm is a sequential algorithm. Even if with 100 processors your computation would...

Last time I talked about the several kinds of parallelism , now I'd like to talk about the methodology we can use in designing a parallel algorithms, The Foster's Methodology. First, let's define first a Unit of Computation and call it a Task. A Parallel Computation is merely a set of Tasks...