High energy & nuclear physics

“Hardware and software infrastructure that provides dependable, consistent, pervasive and inexpensive access to high-end computational capabilities” (I. Foster)

Performance criteria:

• security
• reliability
• computing power
• latency
• throughput
• scalability
• services

Large scale

• Large scale

• Heterogeneity

• Multiple administration domain

• Autonomy… and coordination

• Dynamicity

• Flexibility

• Extensibility / Scalability

• Security

Authentication/Authorization/Traceability

• Authentication/Authorization/Traceability

• Activity control (monitoring)

• Resource discovery

• Resource brokering

• Scheduling

• Job submission, data access/migration and execution

• Accounting

End system (computer, disk, sensor…)

• End system (computer, disk, sensor…)

• multithreading, local I/O

• Cluster

• synchronous communications, DSM, parallel I/O
• parallel processing

• Intranet/Organization

• heterogeneity, distributed admin, distributed FS and databases
• load balancing
• access control

• Internet/Grid

• global supervision
• brokers, negotiation, cooperation…

Resource sharing

• Resource sharing

• Computers, storage, sensors, networks, …
• Heterogeneity of device, mechanism, policy
• Sharing conditional: negotiation, payment, …

• Coordinated problem solving

• Integration of distributed resources
• Compound quality of service requirements

• Dynamic, multi-institutional virtual orgs

• Dynamic overlays on classic organization structures
• Map to underlying control mechanisms

Description

• Description

• Advertising

• Cataloging

• Matching

• Claiming

• Reserving

• Checkpointing

Services and protocols depend on the infrastructure

• Services and protocols depend on the infrastructure

• Some parameters

• stability of the infrastructure (same set of resources or not)
• freshness of the resource availability information
• reservation facilities
• multiple resource or single resource brokering

• Example of request: I need from 10 to 100 CE each with at least 512 MB RAM and a computing power of 150 Mflops

Levels of scheduling

• Levels of scheduling

• job scheduling (global level ; perf: throughput)
• resource scheduling (perf: fairness, utilization)
• application scheduling (perf: response time, speedup, produced data…)

• Mapping/Scheduling process

• resource discovery and selection
• assignment of tasks to computing resources
• data distribution
• task scheduling on the computing resources
• (communication scheduling)