European Middleware Initiative
The European Middleware Initiative (EMI) is a computer software platform for high performance distributed computing. It is developed and distributed directly by the EMI project.[1][2][3] It is the base for other grid middleware distributions used by scientific research communities and distributed computing infrastructures all over the world especially in Europe,[4] South America[5] and Asia.[6] EMI supports broad scientific experiments and initiatives, such as the Worldwide LHC Computing Grid (for the Large Hadron Collider).
Developer(s) | EMI Project, partially funded by EU grant RI-261611 |
---|---|
Stable release | 3.0
/ 28 February 2013 |
Operating system | Scientific Linux 5 64bit, Scientific Linux 6 64bit, Debian 6 64bit |
Type | Grid computing |
License | Multiple. Each product has its own. Most of them are Apache or BSD. |
Website | www.eu-emi.eu (not active anymore) |
The EMI middleware is a cooperation among three general purpose grid platforms, the Advanced Resource Connector, gLite and UNICORE and the dCache storage software.[7]
Purpose
The purpose of the EMI distribution is to consolidate, harmonize and support the original software platforms, evolve and extend them. Redundant or duplicate services resulting from the merging are deprecated, in favour of new services added to satisfy user requirements or specific consolidation needs, standardizing and developing common interfaces. These include the adoption of a common structure for accounting, resource information exchange or authentication and authorization.
Input for the development activities is taken from users, infrastructures projects, standardization initiatives or changing technological innovations. The software products will be adapted as necessary to comply with standard open-source guidelines to facilitate the integration in mainstream operating system distributions.[8]
Collaborations
A cooperation with FutureGrid, a US distributed testbed for Clouds, Grids and high-performance computing, was announced in December 2011.[9]
In January 2012, the EMI project formalized a partnership with the iMarine project to create an open data e-infrastructure for fisheries management and marine conservation.[10][11]
Users
By 2008 the EMI software distribution provided most of the middleware components which support the execution and completion of the millions of computational jobs handled by the 350 centers of the European Grid Infrastructure and the tens of petabytes of data transfers occurring between the storage systems of those centers.[12][13]
EMI middleware was used in the WLCG infrastructure which supports, for example, the search for the Higgs boson (the God Particle)[14] and new types of matter searches of the physicists at LHC together with other research in astronomy, biology, computational chemistry and other sciences.[15]
License
There is no common EMI license though all licenses used by EMI are open-source. Each product has a long history behind its own license. Most are Apache or BSD.[16]
dCache products are released under the dCache Software License[17] but they adopted the Affero General Public License from 1 January 2012.
Products
The EMI products (components of the release) can be grouped in four categories (areas): computing, data, security and infrastructure.[18]
The first release[19] of the software is composed of 56 products packaged for Scientific Linux 5 (32, 64bit).
The second release[20] is also made of 56 products which are available for Scientific Linux 5 64bit and Scientific Linux 6 64bit. A subset of services is also available for Debian 6 64bit with more planned with the updates.
The third and final release[21] contains 61 products for the Scientific Linux 5 64bit (480 packages), Scientific Linux 6 64bit (474 packages) and Debian 6 (233 packages) Linux distributions. All components are supported on the Scientific Linux platforms while some are not on Debian.
Releases
EMI releases are of two types. Major releases include most if not all components and Component Releases which is related to a single product. A collection of components may be released as an update to a major release.[22]
Major releases
Major releases are delivered once per year. Three planned major releases were named after European mountains.
Release | Name | Release Date | End of Full Support | End of Standard Updates | End of Security Updates and Support |
---|---|---|---|---|---|
1.0 | Kebnekaise | 2011-05-12 | 2012-04-30 | 2012-10-31 | 2013-04-30 |
2.0 | Matterhorn | 2012-05-21 | 2013-04-30 | 2013-10-31 | 2014-04-30 |
3.0 | Monte Bianco | 2013-02-28 | 2014-04-30 | 2014-10-31 | 2015-04-30 |
Full Support: updates are released to address issues in the code and new features are provided (lasts 12 months)
Standard Updates: updates are released to address issues in the code but no new features are provided (lasts 6 months)
Security Updates and Support: only updates targeting security vulnerabilities are provided (6 months)
As older versions of the EMI products are superseded by newer versions, an end-of-life announcement is made which coincides with the end of the security updates and support period.
As of May 2013, 24 updates were released for EMI 1 Kebnekaise,[23] 13 for EMI 2 Matterhorn[24] and 3 for EMI 3 Monte Bianco.[25]
Component releases
Minor Releases: contain interface or functional changes that are backwards-compatible with those of the current major release. They are issued a few times per year.
Revision Releases: available every week or two weeks. They contain only bug fixes.
Emergency Releases: contain only very specific bug fixes, typically security-related and are available as need, using emergency release procedures.
References
- "Featured article: EMI, home to middleware". iSGTW. June 2010. Retrieved 22 December 2011.
- "Presentation of the European Middleware Initiative project". GridCast. 16 September 2010. Retrieved 22 December 2011.
- "European Middleware Initiative project presentation". GridCafè. 2010. Archived from the original on 4 December 2010. Retrieved 22 December 2011.
- "The EGI Software Repository Portal". EGI. Retrieved 22 December 2011.
- "Iniciativa de Grid de America Latina-Caribe. Resource Center Reference". IGALC. Archived from the original on 26 April 2012. Retrieved 25 December 2011.
- "Taiwan Grid Portal". TWGrid. Retrieved 26 December 2011.
- "EMI web site home page". EMI. Archived from the original on 26 December 2011. Retrieved 22 December 2011.
- "EMI software releases introduction". EMI. Archived from the original on 17 December 2011. Retrieved 22 December 2011.
- "EMI collaboration announcement. FutureGrid Portal". FutureGrid. Retrieved 26 December 2011.
- "iMarine collaboration announcement on CORDIS portal". CORDIS. Retrieved 14 February 2012.
- "iMarine collaboration announcement on iSGTW". iSGTW. Retrieved 14 February 2012.
- Vetterli, M. (2 July 2008). "ATLAS Computing: Dealing with Petabytes of Data per Year". 2008 22nd International Symposium on High Performance Computing Systems and Applications. High Performance Computing Systems and Applications, 2008. HPCS 2008. IEEE. p. 84. doi:10.1109/HPCS.2008.36. ISBN 978-0-7695-3250-9. ISSN 1550-5243.
- Jacqui Hayes (21 December 2011). "Happy 10th Birthday, WLCG!". isgtw. Archived from the original on 12 May 2015. Retrieved 23 December 2011.
- Leslie Versweyveld (13 September 2010). "WLCG working hard to make the Higgs particle theory come true". PRIMEUR. Retrieved 23 December 2011.
- "EMI services used in neuro-scientific grand challenge". isgtw. 3 October 2011. Retrieved 23 December 2011.
- "EMI DNA2.4.2, Exploitation and Sustainability Plan, EU Deliverable: D2.4.2" (PDF). EMI. 30 April 2011. p. 13. Retrieved 22 December 2011.
- "dCache Software License". dCache. Retrieved 22 December 2011.
- "EMI Software products categories". EMI. Archived from the original on 17 November 2011. Retrieved 22 December 2011.
- "1st EMI Release (Kebnekaise)". EMI. Archived from the original on 17 January 2012. Retrieved 22 May 2012.
- "2nd EMI Release (Matterhorn)". EMI. Archived from the original on 23 November 2014. Retrieved 22 May 2012.
- "3rd EMI Release (Monte Bianco)". EMI. Archived from the original on 15 June 2013. Retrieved 13 May 2013.
- "EMI Software Releases". EMI. Archived from the original on 17 December 2011. Retrieved 22 December 2011.
- "Updates for the 1st EMI Release (Kebnekaise)". EMI. Archived from the original on 28 July 2014. Retrieved 13 May 2013.
- "Updates for the 2nd EMI Release (Matterhorn)". EMI. Archived from the original on 15 April 2014. Retrieved 13 May 2013.
- "Updates for the 3rd EMI Release (Monte Bianco)". EMI. Archived from the original on 13 April 2014. Retrieved 13 May 2013.
External links
- EMI Project official website
- EMI software repository
- ARC official website
- dCache official website
- gLite official website
- UNICORE official website
- EGI official website
- FutureGrid official website