A problem is broken into a discrete series of instructions. Then instructions are executed one after another
Back
Parallel overhead
Front
Amount of time required to coordinate parallel tasks.
Back
Parallel computing
Front
Simultaneous use of multiple compute resources to solve a computational problem
Back
Task
Front
A logically discrete section of computational work
Back
Parallel task
Front
It can be executed by multiple processors safely. It yields correct results
Back
Distributed
Front
Network based memory access. Tasks must use communications to access memory on other machines where other tasks are executing
Back
Granularity
Front
A qualitative measure of the radio of computation to communication
Back
Flynn's taxonomy
Front
Single instruction/Single data, Single instruction/Multiple data, Multiple instruction/Single data, Multiple instruction/Multiple data
Back
Shared memory
Front
All processors have different access to common physical memory. It describes a model where different parallel tasks access the same logical memory locations.
Back
Serial computing
Front
One statement at a time. This happens on a one-processor machine
Back
Synchronization
Front
The coordination of parallel tasks in real time. It is associated with communications. It usually involves waiting for at least one task to be completed