European Grid Infrastructure Explained

EGI
Type:Scientific support
Foundation:2010
Hq Location:Science Park 140 1098 XG
Hq Location Country:The Netherlands
Area Served:Europe

European Grid Infrastructure (EGI) is a series of efforts to provide access to high-throughput computing resources across Europe using grid computing techniques.[1] The EGI links centres in different European countries to support international research in many scientific disciplines. Following a series of research projects such as DataGrid and Enabling Grids for E-sciencE, the EGI Foundation was formed in 2010 to sustain the services of EGI.[2]

Purpose

Science has become increasingly based on open collaboration between researchers across the world. It uses high-capacity computing to model complex systems and to process experimental results.In the early 21st century, grid computing became popular for scientific disciplines such as high-energy physics and bioinformatics to share and combine the power of computers and sophisticated, often unique, scientific instruments in a process known as e-Science.[2]

In addition to their scientific value, on 30 May 2008 The EU Competitiveness Council promoted "the essential role of e-infrastructures as an integrating mechanism between Member States, regions as well as different scientific disciplines, also contributing to overcoming digital divides."[3]

EGI is partially supported by the EGI-InSPIRE EC project.

History

The European DataGrid project was first funded in 2001 for three years as one of the Framework Programmes for Research and Technological Development series.[4] [5] Fabrizio Gagliardi was project manager of DataGrid and its budget was about 12 million euro, with the full project named "Research and Technological Development for an International Data Grid".[6]

A major motivation behind the concept was the massive data requirements of CERN's LHC (Large Hadron Collider) project.[7]

EGEE

On 1 April 2004 the Enabling Grids for E-Science in Europe (EGEE) project was funded by the European Commission through the Directorate-General for Information Society and Media, led by the information technology division of CERN.[8] This 24-month project of the Sixth Framework Programme had a cost of over 46 million euro. The consortium included 70 institutions in 27 countries.[8] The LHC Computing Grid continued to be a major application of EGEE technology.[9] By 1 April 2006 the "in Europe" was dropped from the project name, but the acronym was kept as EGEE-II for Enabling Grids for E-sciencE. This two-year phase cost about 52.6 million euro.[10] The new name reflected a more global extent, such as a cluster of computers at the Institute of Microelectronic Systems in Malaysia.[11] By 2007 the EGI was supported by 36 countries.[12]

A middleware software package known as gLite was developed for EGEE.[13]

A third two-year project phase was called EGEE-III, running from 2008 to 2010.On 30 April 2010 the EGEE project ended.[14] By 2009 the governance model evolved towards a European Grid Initiative (EGI), building upon National Grid Initiatives (NGIs).[15]

Related projects

DILIGENT & D4Science

A project called Diligent[16] [17] [18] (DIgital LIbrary Infrastructure on Grid ENabled Technology) was funded from 1 September 2004 to 30 November 2007, and developed an open source software called gCube system[19] conceived to be interoperable with the EGEE technology. This project cost more than 8.9 million euro.Follow-on projects called distributed collaboratories infrastructure on grid enabled technology 4 science (D4Science) cost about 3.9 million euro through the end of 2009,[20] and 5.4 million euro until September 2011.[21] These projects initiated the development of the D4Science organization and its Data Infrastructure that is interoperable with the EGI services.

BEinGRID

A project on Business Experiments in GRID (BEinGRID) ran from 1 June 2006, through November 2009, with a cost estimated 23.6 million euro.[22] The project published 25 case studies.[23] One participant observed in 2008 "a reluctant and slow take-off of Grid technology by the industry."[24]

Yaim

YAIM was initially called Yet Another Installation Method in 2007 when developed at CERN.[25]

YAIM was implemented to configure grid services, but also can be a general purpose configuration tool independent from the grid middleware. YAIM aimed to provide simple configuration methods that can be used to set up uniform grid sites but can also be easily adapted to meet the needs of larger sites. To adapt to local requirements, it was implemented as a set of bash scripts. To support EGEE's component based release model YAIM 4 was modularized and a YAIM core is supplemented by component specific scripts, distributed as separate rpms.

YAIM's modular structure allows distributed and asynchronous development for the quickly changing configuration requirements of the Grid Middleware.

The hierarchical configuration storage - which is to reflect the architecture of a grid site - and the configurable function behavior implement the local settings along with YAIM's default configuration.

Design study

The EGI Design Study (EGI_DS) project was launched in September 2008 and continued until the end of December 2009. The project was partially funded by the European Commission's 7th Framework Programme in order to: evaluate requirements and use cases, identify processes and mechanisms for establishment, define the structure, and initiate the organization.[26] [27]

The study was directed by Dieter Kranzmüller, and cost about 3.9 million euro.[1] [28] In October 2008 site selection for EGI was begun.[29] Participants included 37 national projects.[30]

Structure

In March 2009, the policy board of the EGI announced it would be hosted in Amsterdam, the Netherlands at the Science Park Amsterdam.[31] The EGI.eu foundation was officially formed on 8 February 2010 in Amsterdam.[32] The name change included using infrastructure as the third word for the acronym, to reflect the transition from a series of short-term research projects to a more sustainable service.[33]

National Grid Initiatives (NGI) support scientific disciplines for computational resources within individual countries. The EGI is governed by a Council of representatives from each member NGI, which controls an executive that manages the international collaboration between NGI, so that individual researchers can share and combine computing resources in international collaborative research projects.

The governance model of the EGI coordinating the collaboration of National Grid Initiatives uses general policies of co-operation and subsidiarity adopted in the European Research Area.

A 32-million-euro project named the EGI-Integrated Sustainable Pan-European Infrastructure for Research in Europe (EGI.INSPIRE) was funded in September 2010 under direction of Steven Newhouse.[34] A 1.5-million-euro project called e-ScienceTalk was funded in 2010 for 33 months to support websites and publications covering the EGI.[35] It followed an earlier programme known as GridTalk that was funded from 2008 to 2010.[36] [37]

See also

External links

Notes and References

  1. News: Grid Infrastructure Organization . Christopher Lazou . 14 April 2008 . European Parliament Magazine . 8–9 . 265 . 2 October 2011 .
  2. Web site: History of EGI . EGI.eu website . 4 October 2011 . https://web.archive.org/web/20120302120923/http://www.egi.eu/about/history_of_EGI.html . 2 March 2012 . dead .
  3. http://ec.europa.eu/research/infrastructures/pdf/spring_council-conclusions_0608_en.pdf European Competitiveness Council, Conclusions on European Research Infrastructures and their regional dimension, Brussels, 3 June 2008
  4. Web site: EGEE-III Project Publishable Summary . Enabling Grids for E-sciencE . 8 June 2010 . 2 October 2011 . https://web.archive.org/web/20130406124614/http://www.eu-egee.org/fileadmin/documents/publications/EGEEIII_Publishable_summary.pdf . 6 April 2013 . dead .
  5. Web site: The DataGrid Project . CERN . March 2004 . 2 October 2011 . 31 August 2016 . https://web.archive.org/web/20160831054519/http://eu-datagrid.web.cern.ch/eu-datagrid/ . dead .
  6. Web site: Research and Technological Development for an International Data Grid . Project IST-2000-25182 description . European Community Research and Development Information Service . 7 October 2011 .
  7. The European DataGrid Project . Robert J. Wilson . Snowmass 2001 . American Physical Society . 22 October 2001 . 2 October 2011.
  8. Web site: Enabling grids For E-science . Project description . European Community Research and Development Information Service . 2 October 2011 .
  9. Book: LHC Computing Grid: Technical Design Report . document LCG-TDR-001, CERN-LHCC-2005-024 . 20 June 2005 . The LCG TDR Editorial Board . 92-9083-253-3 . 3 October 2011 .
  10. Web site: Enabling grids for E-sciencE-II . Project description . European Community Research and Development Information Service . 2 October 2011 .
  11. News: Computer grid grows in power . The Star Online . Jo Timbuong . 24 April 2008 . Kuala Lumpur . https://archive.today/20120713111056/http://newscentre.msc.com.my/articles/312/1/Computer-grid-grows-in-power/ . dead . 13 July 2012 . 2 October 2011 .
  12. News: 36 national grids initiatives in Europe support the EGI concept . Innovations Report . Leena Jukka . 5 September 2007 . 3 October 2011 .
  13. Web site: gLite – Lightweight Middleware for Grid Computing . CERN . 3 October 2011 .
  14. Web site: EGEE Portal: Enabling Grids for E-sciencE . Official web site . dead . https://web.archive.org/web/20100619145027/http://www.eu-egee.org/ . 19 June 2010 . 2 October 2011.
  15. Web site: ICT Infrastructures for e-Science . Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee of the Regions . Brussels . 5 March 2009 . 2 October 2011 .
  16. Web site: Diligent Project . Defunct website . dead . https://web.archive.org/web/20081104091949/http://www.diligentproject.org/ . 4 November 2008 . 3 October 2011 .
  17. Web site: A testbed digital library infrastructure on grid enabled technology . Project description . European Community Research and Development Information Service . 3 October 2011 .
  18. L. . Candela. F. . Akal. H. . Avancini. D. . Castelli. L. . Fusco. V. . Guidetti. C. . Langguth. A. . Manzi. P. . Pagano. H. . Schuldt. M. . Simi. M. . Springmann. L. . Voicu. 2007. DILIGENT: integrating digital library and Grid technologies for a new Earth observation research infrastructure. International Journal on Digital Libraries. 7. 1–2. 59–80. 10.1007/s00799-007-0023-8 . 29730933.
  19. M. . Assante. L. . Candela. D.. Castelli. R. . Cirillo. G. . Coro. L. . Frosini. L. . Lelii. F. . Mangiacrapa. V. . Marioli. P. . Pagano. G. . Panichi. C. . Perciante. F. . Sinibaldi. 2019. The gCube system: Delivering Virtual Research Environments as-a-Service. Future Generation Computer Systems . 95 . 445–453 . 10.1016/j.future.2018.10.035 .
  20. Web site: DIstributed colLaboratories infrastructure on Grid enabled technology 4 science . Project description . European Community Research and Development Information Service . 3 October 2011 .
  21. Web site: Data Infrastructure Ecosystem for Science . Project description . European Community Research and Development Information Service . 3 October 2011 .
  22. Web site: Business experiments in GRID . Project 034702 fact sheet . European Community Research and Development Information Service . 9 October 2011 .
  23. Web site: Business Experiments in Grid: BEinGRID . Project web site . European Community Research and Development Information Service . dead . https://web.archive.org/web/20110723100417/http://www.beingrid.eu/ . 23 July 2011 . 9 October 2011 .
  24. Service oriented infrastructure: Meeting customer needs . Claire Gresty . George Thanos . Theo Dimitrakos . Paul Warren . January 2008 . BT Technology Journal . 26 . 1 . 9 October 2011 .
  25. Web site: YAIM 4 reference guide . CERN . 30 August 2007 . 3 October 2011 .
  26. Web site: European Grid Initiative Design Study . Official website . 2009 . 2 October 2011 . https://web.archive.org/web/20110920131229/http://web.eu-egi.eu/ . 20 September 2011 . dead .
  27. News: Europeans connecting through the Grid . European Research Headlines . European Commission . 14 September 2007 . 3 October 2011 .
  28. Web site: European grid initiative design study . Project 211693 description . European Community Research and Development Information Service . 2 October 2011 .
  29. News: Euroopan grid-organisaatio hakee kotipaikkaa . fi . 17 October 2008 . Digitoday . 2 October 2011 .
  30. News: Scientists join forces to create European grid computing infrastructure . 25 September 2007 . News release . European Community Research and Development Information Service . 2 October 2011 .
  31. News: European Grid Initiative Head Office comes to Science Park Amsterdam . 23 March 2009 . News release . . 2 October 2011 .
  32. News: EGI.eu founded . 11 February 2010 . News release . Rob van der Meer . EGI.eu . 3 October 2011 . https://web.archive.org/web/20120305133526/http://www.egi.eu/about/news/news_0002.html . 5 March 2012 . dead .
  33. News: Establishing EGI.eu . 26 . Projects . British Publishers . 3 October 2011.
  34. News: Work on pan-European grid infrastructure moves to next level . 16 September 2010 . News release . European Community Research and Development Information Service . 2 October 2011 .
  35. Web site: e-ScienceTalk: Supporting Grid and High Performance Computing reporting across Europe . 1 September 2010 . Project 260733 summary . European Community Research and Development Information Service . 4 October 2011 .
  36. Web site: GridTalk: co-ordinating grid reporting across Europe . 1 May 2010 . Project 223534 summary . European Community Research and Development Information Service . 4 October 2011 .
  37. Web site: About GridTalk . Official website . 2010 . live . 25 April 2012 . https://web.archive.org/web/20120425045537/http://www.gridtalk.org/about.htm . 4 October 2011.