Astronomy- Digital sky surveys: modern telescopes produce over 10 Petabytes per year (upto 30 TB per day)!
Molecular genomics
Chemistry and biochemistry
Financial applications
Medical images
…
Note: a special case of 1936 Wright’s Law about he cost of airplanes?
Note: a special case of 1936 Wright’s Law about he cost of airplanes?
Moore’s Law (processing) (1965)
The number of transistors on integrated
circuits doubles every two years
Correlate: the computing power
doubles every 18 months
Seems to become less true…
Kryder’s Law (storage) (2005)
Storage capacity doubles every 12 months
Butter's law (optical fiber)
The amount of data coming out of an optical fiber is doubling every 9 months
In 3 years (36 months), networkx16, storagex8, processingx4
In 9 years (108 months), networkx4096, storagex512, processingx64
A Quick Overview of Distributed System Models
A Quick Overview of Distributed System Models
An Introduction to Grid Computing
An Introduction to Cloud Computing
Distributed system
Distributed system
Parallel system
Cluster computing
Meta-computing
Grid computing
Peer to peer computing
Global computing
Internet computing
Network computing
Cloud computing
N autonomous computers (sites): n administrators, n data/control flows
N autonomous computers (sites): n administrators, n data/control flows
an interconnection network
User view: one single (virtual) system
«A distributed system is a collection of independent computers that appear to the users of the system as a single computer » Distributed Operating Systems, A. Tanenbaum, Prentice Hall, 1994
« Traditional » programmer view: client-server
1 computer, n nodes: one administrator, one scheduler, one power source
1 computer, n nodes: one administrator, one scheduler, one power source
memory: it depends
Programmer view: one single machine executing parallel codes. Various programming models (message passing, distributed shared memory, data parallelism…)
Use of PCs interconnected by a (high performance) network as a parallel (cheap) machine
Use of PCs interconnected by a (high performance) network as a parallel (cheap) machine
Two main approaches
Dedicated network (based on a high performance network: Infiniband, Fiber Channel, GB-Ethernet...)
Non-dedicated network (based on a (good) LAN)
1993 (prehistoric times!)
1993 (prehistoric times!)
n°1: 59.7 GFlops
n°500: 0.4 Gflops
Sum = 1.17 TFlops
Ranked 1st in the top500 list of the most “powerful” (computing intensive) computers (since June 2013)
Ranked 1st in the top500 list of the most “powerful” (computing intensive) computers (since June 2013)
Ranked 6th in the graph500 list of the most “powerful” (data intensive processing) computers (June 2013)
Ranked 32nd in the green500 list of the most energy efficient computer (June 2013) and 57th in December 2014