1 computer, n nodes: one administrator, one scheduler, one power source
1 computer, n nodes: one administrator, one scheduler, one power source
memory: it depends
Programmer view: one single machine executing parallel codes. Various programming models (message passing, distributed shared memory, data parallelism…)
Use of PCs interconnected by a (high performance) network as a parallel (cheap) machine
Use of PCs interconnected by a (high performance) network as a parallel (cheap) machine
Two main approaches
Dedicated network (based on a high performance network: Infiniband, Fiber Channel, GB-Ethernet...)