JINR participation in the project for development of Russian Grid Network
In September 2009 the Commission under the President of the Russian Federation on the modernization and technological development of economy of Russia approved a list of projects in the field of “The development of supercomputers and grid computing” and, in which the project on the development of grid-based networks for high performance computing was approved. In 2010 a pilot zone of the Russian national grid network (RGN) has been established. One of the main tasks of the project was to create a network infrastructure and connection to it of largest supercomputer centers, enterprises, high-tech industries and research organizations. Since 2011, the work on creating of the basic Grid services infrastructure for the RGN prototype, security systems, adapting software packages for use in the grid environment begun. This project was completed by the end of 2012.
The main objectives of the RGN project were:
- creation of a network linking resource centers (supercomputers) and major consumers;
- development of basic Grid services for the construction of RGN infrastructure;
- connection of supercomputer centers using the grid gateways;
- creation of a Web portal to access the system, the creation of user interfaces (preparation and – execution of user jobs, data transfer, license management, etc.);
- creation of the security system.
In 2011, the major organizations implementing the project of creation of the RGN grid infrastructure were Research Institute “Voskhod”, SINP MSU, JINR, T-Platforms, CC FEB RAS, TESIS Engineering Company.
Joint Institute for Nuclear Research, in cooperation with SINP MSU worked on the development and deployment of basic Grid services, as well as the adaptation of application software packages and development of problem oriented web interfaces to work with such applications.
Core grid services
The main grid services developed in the frames of the RGN project were:
- Grid gateway to start jobs in the resource centers (SINP MSU);
- service of multi-step jobs execution (SINP MSU);
- Information System (SINP MSU);
- resources’ accounting subsystem (collection of data on the use of computing resources in the resource centers) (JINR);
- monitoring subsystem (monitoring of resources, services and jobs in a grid network) (JINR);
- users’ and VO accounting subsystem (the consumption of resources by users and virtual organizations) (JINR);
- service of Registration Resource and Grid services (JINR).
The monitoring subsystem is used for collecting, storing and providing information on the status of Grid resources and services network, as well as information about running in the user’s jobs. The current status of resources, tasks and other objects in the system are collected from all Grid services into a single database. Both static and dynamic information is used (e.g, the state of the queue on the computing cluster). The processed information is provided for Grid administrators, managers of virtual organizations (VO) and grid end-users via a web interface.
The accounting subsystem is used for collecting, storing and providing information about grid computing resources consumed by user jobs. Information is provided to the billing system, grid administrators, managers of virtual organizations (VO) and grid end-users.
The main task solved by the resources and grid services registration service, is to store and provide information about resources and grid services in RGN environment. The ability to enter and modify data is provided for administrators and users of the system and also it is possible to display information in a machine-oriented and intended for human representations. Authorization and authentication is used to differentiate the rights and roles of access in adding, modifying or accessing information.
Developed services were used in the deployment of a prototype of grid network based on the Research Institute “Voskhod”and several resource centers.
Problem-oriented web interfaces (POI) for application software packages
Problem-oriented web interfaces (POIs) for a set of application software packages were developed to simplify work of the users in the Russian grid network (i.e. such operations as the creation and submitting of jobs, monitoring of their execution and getting the results of the calculations). POIs hide from the user details and complexity of the work in the Grid environment. To provide job execution the application packages must be installed on the worker nodes of the RGN Grid sites.
LIT team has developed the POIs to such application packages as DL_POLY (molecular dynamics), Elmer (engineering calculations) and GEANT4-DNA (simulation of biological damage induced by ionising radiation at the cellular and subcellular scale). To carry out these works,”Web-based GUI” service has been installed on the educational and testing grid infrastructure and POIs were developed in the form of plug-ins for these applications. Then testing grid site was deployed in the RGN testbed.
Screenshots of POI for three applications mentioned above are shown in the figures below.
Developed POIs allow the user to specify the job name (by default POI will automatically generate in the appropriate field a name of job, consisting of a package name, current date and time), specify the desired environment on the worker nodes, specify the required number of processors (for DL_POLY and Elmer), select the archive of the input data that must be prepared by the same means as in the work with the package outside the grid environment, specify the file name for the file with the output data (if the name in the “Archives of output” POI field is not defined by the user, then it will be the name of “output.tar.gz”). Once the required fields filled in, to run the job in RGN user must click on the POI button “Start”. The result of this action will be seen in the window titled as “Log”. Tracking the status of the jobs is provided by the menu “Start-up and control”.