Parallelism by Alim Khan https://padlet.com/85651/jqpr0gh6mbes Made with swagger en-us 2017-09-20 08:21:41 UTC 2023-04-05 00:09:37 UTC hello@padlet.com Parallelism - By Alim Khan 85651 https://padlet.com/85651/jqpr0gh6mbes/wish/189212565 The use of parallel processors to solve a computational issue.
No the CPU IS NOT exactly the brain of the computer!]]> 2017-09-20 08:24:01 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189212565 CPU is scientifically proven to be the BRAIN of the computer https://padlet.com/85651/jqpr0gh6mbes/wish/189212769 2017-09-20 08:24:46 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189212769 Parallel computing is a type of computation in which many calculations or the execution of processes are carried out simultaneously https://padlet.com/85651/jqpr0gh6mbes/wish/189212852 HenOS]]> 2017-09-20 08:25:04 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189212852 A computer program is, in essence, a stream of instructions executed by a processor. Without instruction-level parallelism, a processor can only issue less than one instruction per clock cycle (IPC < 1). These processors are known as sub scalar processors. https://padlet.com/85651/jqpr0gh6mbes/wish/189212872 2017-09-20 08:25:09 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189212872 Parallel computing is the use of two or more processors (cores, computers) in combination to solve a single problem. https://padlet.com/85651/jqpr0gh6mbes/wish/189213230 2017-09-20 08:26:29 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189213230 a pipeline is a set of data processing elements connected in series, where the output of one element is the input of the next one. The elements of a pipeline are often executed in parallel or in time-sliced fashion; in that case, some amount of buffer storage is often inserted between elements. https://padlet.com/85651/jqpr0gh6mbes/wish/189213299 2017-09-20 08:26:46 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189213299 Source: http://cse.stanford.edu/class/sophom...ing/index.html https://padlet.com/85651/jqpr0gh6mbes/wish/189213347  Parallel computing is the simultaneous execution of the same task (split up and specially adapted) on multiple processors in order to obtain results faster. The idea is based on the fact that the process of solving a problem usually can be divided into smaller tasks, which may be carried out simultaneously with some coordination.

A parallel computing system is a computer with more than one processor for parallel processing. In the past, each processor of a multiprocessing system always came in its own processor packaging, but recently-introduced multicore processors contain multiple logical processors in a single package. 

There are many different kinds of parallel computers. They are distinguished by the kind of interconnection between processors (known as "processing elements" or PEs) and memory.

Pipelining is a method of increasing system performance and throughput. It takes advantage of the inherent parallelism in instructions. Instructions are divided into 5 stages : IF, ID, EX, MEM, WB. In pipelining, we try to execute 2 or more instructions at the same time thereby increasing the throughput. For more info on pipelining refer to the following website: ]]> 2017-09-20 08:26:58 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189213347 Pipelining is a particular form of parallelism. In general, parallelism is simply multiple operations happening at the same time. Pipelining is a particular arrangement of functions so that different portions of an operation flow through a particular set of sub-functions, with the sub-functions happening in parallel. https://padlet.com/85651/jqpr0gh6mbes/wish/189213707 2017-09-20 08:28:12 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189213707 The relationship of Parallelism with Piplinning 85651 https://padlet.com/85651/jqpr0gh6mbes/wish/189213710 Piplining involves using idle components of a CPU during the FDE cycle. With parallel computing multiple CPUs are used during processing. ]]> 2017-09-20 08:28:14 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189213710 the pipelining breaks a big task into number of small parts. a part higher in order gets processed n serves as an input for the next sub-task,while in parallel processing various tasks are run at the same time https://padlet.com/85651/jqpr0gh6mbes/wish/189214037 2017-09-20 08:29:21 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189214037 Two forms of pipelining https://padlet.com/85651/jqpr0gh6mbes/wish/189214211 –Instruction unit
•overlap fetch-execute cycle so that multiple instructions are being processed at the same time, each instruction in a different portion of the fetch-execute cycle

–Operation unit
•overlap execution of ALU operations
•only useful if execution takes > 1 cycle
–e.g., floating point operations
]]> 2017-09-20 08:29:59 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189214211 Non-Pipeline https://padlet.com/85651/jqpr0gh6mbes/wish/189214379 A non-pipeline architecture is inefficient because some CPU components are idle while another module is active during the instruction cycle.]]> 2017-09-20 08:30:40 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189214379 Do non-pipelined architectures have a future? 85651 https://padlet.com/85651/jqpr0gh6mbes/wish/189214463 Piplining is not exactly the best option as piplining is based on the assumption that everything is sequential. For example, when data is to be moved to an accummulator after another instruction before is being executed the 2nd instruction cannot be executed as the accumulator has data from the 1st instruction means that the 2nd instruction would operate with the wrong data. This creates a bubble in the pipline cycle. 

From this non pipelined archtectures I believe would still have a future based on the above mentioned issue.]]> 2017-09-20 08:31:00 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189214463 parallel processing is the processing of program instructions by dividing them among multiple processors with the objective of running a program in less time. https://padlet.com/85651/jqpr0gh6mbes/wish/189214633 2017-09-20 08:31:31 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189214633 Henris Pipelining Disadvantages https://padlet.com/85651/jqpr0gh6mbes/wish/189214790 Non pipelined cpu is cheaper to manufacture and prevents branch delays and serial executed  concurrently

Flip flop modules increase latency

Entire pipeline flushed in long stages 

Output depends on subsequent instruction

Involves ADDING HARDWARE TO CHIP]]> 2017-09-20 08:32:00 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189214790 Definition https://padlet.com/85651/jqpr0gh6mbes/wish/189215775 parallelism
ˈparəlɛlɪzəm/
noun

  1. the state of being parallel or of corresponding in some way.

  1. "Greek thinkers who believed in the parallelism of microcosm and macrocosm"
    • the use of successive verbal constructions in poetry or prose which correspond in grammatical structure, sound, metre, meaning, etc.
    • plural noun: parallelisms

    • "parallelism suggests a connection of meaning through an echo of form"
    • COMPUTING
    • the use of parallel processing.

    • "massive parallelism gives neural networks a high degree of fault tolerance"
]]> 2017-09-20 08:35:05 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189215775 Parallelism https://padlet.com/85651/jqpr0gh6mbes/wish/189215887 A parallel computer is a set of processors that are able to work cooperatively to solve a computational problem. This definition is broad enough to include parallelsupercomputers that have hundreds or thousands of processors, networks of workstations, multiple-processor workstations, and embedded systems.]]> 2017-09-20 08:35:28 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189215887 Advantages of Pipe-lining https://padlet.com/85651/jqpr0gh6mbes/wish/189215933
 The cycle time of the processor is reduced; increasing the instruction throughput. ... The more pipeline stages a processor has, the more instructions it can process "at once" and the less of a delay there is between completed instructions. ]]> 2017-09-20 08:35:34 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189215933 Parallelism VS PIPELINING! https://padlet.com/85651/jqpr0gh6mbes/wish/189216123  Parallelism involves replicated hardware (exploiting space). Pipelining involves re-using hardware optimally based on dataflows (exploiting time).

Paralellism can do two calculations at the same time in separate compute units. Pipelining can do a calculation twice in incremental time over doing it once, using a single set of compute units. ]]> 2017-09-20 08:36:12 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189216123 https://padlet.com/85651/jqpr0gh6mbes/wish/189216690 2017-09-20 08:38:00 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189216690 https://padlet.com/85651/jqpr0gh6mbes/wish/189217256 Instruction pipe lining is a technique that implements a form of parallelism called instruction-level parallelism within a single processor. It therefore allows faster CPU throughput (the number of instructions that can be executed in a unit of time) than would otherwise be possible at a given clock rate.]]> 2017-09-20 08:39:16 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189217256 Parallel processing https://padlet.com/85651/jqpr0gh6mbes/wish/189217358 There are two basic types of parallel processing; pipeline and partitioning.

 Pipeline parallelism
If you ran the example job on a system with at least three processors, the stage reading would start on one processor and start filling a pipeline with the data it had read.

 Repartitioning data
In some circumstances you might want to actually repartition your data between stages. This might happen, for example, where you want to group data differently. Say you have initially processed data based on customer last name, but now want to process on data grouped by zip code. You will need to repartition to ensure that all customers sharing the same zip code are in the same group. 
]]> 2017-09-20 08:39:32 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189217358 https://padlet.com/85651/jqpr0gh6mbes/wish/189218122 2017-09-20 08:41:33 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189218122 https://padlet.com/85651/jqpr0gh6mbes/wish/189218244 2017-09-20 08:41:57 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189218244 https://padlet.com/85651/jqpr0gh6mbes/wish/189218840 CPU is the brain of the computer]]> 2017-09-20 08:43:46 UTC https://padlet.com/85651/jqpr0gh6mbes/wish/189218840