N autonomous computers (sites): n administrators, n data/control flows
N autonomous computers (sites): n administrators, n data/control flows
an interconnection network
User view: one single (virtual) system
«A distributed system is a collection of independent computers that appear to the users of the system as a single computer » Distributed Operating Systems, A. Tanenbaum, Prentice Hall, 1994
1 computer, n nodes: one administrator, one scheduler, one power source
1 computer, n nodes: one administrator, one scheduler, one power source
memory: it depends
Programmer view: one single machine executing parallel codes. Various programming models (message passing, distributed shared memory, data parallelism…)
Use of PCs interconnected by a (high performance) network as a parallel (cheap) machine
Use of PCs interconnected by a (high performance) network as a parallel (cheap) machine
Two main approaches
Dedicated network (based on a high performance network: Infiniband, Fiber Channel, GB-Ethernet...)
Non-dedicated network (based on a (good) LAN)
1993 (prehistoric times!)
1993 (prehistoric times!)
n°1: 59.7 GFlops
n°500: 0.4 Gflops
Sum = 1.17 TFlops
Ranked 1st in the top500 list of the most “powerful” (computing intensive) computers (since June 2013)
Ranked 1st in the top500 list of the most “powerful” (computing intensive) computers (since June 2013)
Ranked 6th in the graph500 list of the most “powerful” (data intensive processing) computers (June 2013)
Ranked 32nd in the green500 list of the most energy efficient computer (June 2013) and 57th in December 2014