Balazs Konya
Researcher
Performance of the NorduGrid ARC and the Dulcinea Executor in ATLAS Data Challenge 2
Author
Editor
- A. Aimar
- J. Harvey
- N. Knoors
Summary, in English
This talk describes the various stages of ATLAS Data Challenge 2 (DC2)
in what concerns usage of resources deployed via NorduGrid's Advanced
Resource Connector (ARC). It also describes the integration of these
resources with the ATLAS production system using the Dulcinea
executor.
ATLAS Data Challenge 2 (DC2), run in 2004, was designed to be a step
forward in the distributed data processing. In particular, much
coordination of task assignment to resources was planned to be
delegated to Grid in its different flavours. An automatic production
management system was designed, to direct the tasks to Grids and
conventional resources.
The Dulcinea executor is a part of this system that provides interface
to the information system and resource brokering capabilities of the
ARC middleware. The executor translates the job definitions recieved
from the supervisor to the extended resource specification language
(XRSL) used by the ARC middleware. It also takes advantage of the ARC
middleware's built-in support for the Globus Replica Location Server
(RLS) for file registration and lookup.
NorduGrid's ARC has been deployed on many ATLAS-dedicated resources
across the world in order to enable effective participation in ATLAS
DC2. This was the first attempt to harness large amounts of strongly
heterogeneous resources in various countries for a single
collaborative exercise using Grid tools. This talk addresses various
issues that arose during different stages of DC2 in this environment:
preparation, such as ATLAS software installation; deployment of the
middleware; and processing. The results and lessons are summarized as
well.
in what concerns usage of resources deployed via NorduGrid's Advanced
Resource Connector (ARC). It also describes the integration of these
resources with the ATLAS production system using the Dulcinea
executor.
ATLAS Data Challenge 2 (DC2), run in 2004, was designed to be a step
forward in the distributed data processing. In particular, much
coordination of task assignment to resources was planned to be
delegated to Grid in its different flavours. An automatic production
management system was designed, to direct the tasks to Grids and
conventional resources.
The Dulcinea executor is a part of this system that provides interface
to the information system and resource brokering capabilities of the
ARC middleware. The executor translates the job definitions recieved
from the supervisor to the extended resource specification language
(XRSL) used by the ARC middleware. It also takes advantage of the ARC
middleware's built-in support for the Globus Replica Location Server
(RLS) for file registration and lookup.
NorduGrid's ARC has been deployed on many ATLAS-dedicated resources
across the world in order to enable effective participation in ATLAS
DC2. This was the first attempt to harness large amounts of strongly
heterogeneous resources in various countries for a single
collaborative exercise using Grid tools. This talk addresses various
issues that arose during different stages of DC2 in this environment:
preparation, such as ATLAS software installation; deployment of the
middleware; and processing. The results and lessons are summarized as
well.
Department/s
- Particle and nuclear physics
- Structural Mechanics
Publishing year
2005
Language
English
Pages
1095-1098
Publication/Series
CERN-2005-002
Volume
2
Full text
- Available as PDF - 445 kB
- Download statistics
Document type
Conference paper
Publisher
CERN
Topic
- Subatomic Physics
Keywords
- NorduGrid ATLAS Data-challenge
Conference name
Computing in High Energy Physics CHEP'04
Conference date
2004-09-27
Conference place
Interlaken, Switzerland
Status
Published
Project
- ATLAS
Research group
- ATLAS