Posts

Showing posts with the label Distributed and parallel computing

explain classification of PRAM model

explain classification of PRAM model The PRAM model is an extension of the familiar RAM model of sequential computation that is used in algorithm analysis. We will use the synchronous PRAM which is defined as follows. 1. There are p processors connected to a single shared memory. 2. Each processor has a unique index 1 <=   i <=   p called the processor id . 3. A single program is executed in single-instruction stream, multiple-data stream (SIMD) fashion. Each instruction in the instruction stream is carried out by all processors simultaneously and requires unit time, regardless of the number of processors.

Gustafson’s law

Image
Gustafson’s law :- Gustafson's Law says that if you apply   P   processors to a task that has serial fraction   f , scaling the task to take the same amount of time as before, the speedup is Gustafson demonstrated with a 1024-processor system that the basic presumptions in Amdahl’s Law are inappropriate for massive parallelism [Gustafson88]. Gustafson found that the underlying principle that “the problem size scales with the number of processors, or with a more powerful processor, the problem expands to make use of the increased facilities is inappropriate” [Gustafson88]. Gustafson’s empirical results demonstrated that the parallel or vector part of a program scales with the problem size. Times for vector start-up, program loading, serial bottlenecks, and I/O that make up the serial component of the run do not grow with the problem size

Moore law and Amdahl law

  Moore law :- The   observation   that   steady   technological   improvements   in miniaturization   leads   to   a   doubling   of   the   density   of   transistors   on   new integrated   circuits   every   18   months.   In   the   mid-1960s,   Gordon   Moore (born   1929),   one   of   the   founders   of   Intel   corporation ,   observed   that the   density   of   transistors   had   been   doubling   every   year,   although   the pace   slowed   slightly   in   the   following   years.   The   18-month   pattern   heldtrue   into   the   21st   century,   though   as   technology   approaches   thepoint   where   circuits   ar...