July 31, 2019

ESCAPE Work package 2 DIOS held a workshop from 1-3 July 2019. Over the months up to July 2019, WP2 meetings have taken place every two weeks which have introduced the WP2 team to a variety of technologies relevant for the Data Lake concept. At the workshop, two additional technology areas were presented: these were the options for “Information Systems” for the distributed storage and compute (where CRIC was identified as a good option to take forward in the prototype) and on Networking technologies for monitoring network behaviours (for example, using PerfSONAR boxes to gather network health information).

Following this initial WP2-specific session, a plenary session was held (with WP5 participants) comprising presentations on (1) the software and service repository of WP3 and (2) a technology that might be of interest at the WP2/WP5 interface (namely event driven processing).

The second day was a joint day between WP2 and WP5, which included two further presentations on cross-work package topics (the International Virtual Observatory Alliance (WP4) and Authentication, Authorization and Identity management options). After this, the rest of the day was for presentations of the use cases representing each of the infrastructure projects in ESCAPE to ensure that everyone was aware of the range of different ways that each
experiment or observatory anticipates the users to interact with data, and what appropriate scales need to be prototyped for data storage and transfer.

July 3rd was WP2-specific (with WP5 meeting in parallel). During the WP2 session Aris Fkiaras (CERN) presented a proposal for the data lake prototype, showing how an implementation using rucio could be used as a test bed for ESCAPE work, and showing that work is already underway to develop this. WP2 team members discussed next steps and agreed to proceed with the rucio prototype, to contact prospective sites to identify storage elements and to ingerate AAI.

Finally, WP2 members agreed to develop the first deliverable, namely the project plan, over the coming weeks. 

Overall this was a successful meeting, with over 30 participants, giving a good opportunity for
team building and developing a common understanding of the route forward.

All contributions to the meeting can be found here:
https://indico.in2p3.fr/event/19214/contributions/