Very Large Data Processing and Analysis
Nowadays, the sophisticated experiments conducted by the scientific community usually produce huge amounts of data which are needed to be treated before it is possible to extract from them any results. Data processing and analysis is concerned with the performance of the necessary manipulations on a given set of data, in order to extract the required information in an appropriate form such as diagrams, graphics, reports or tables.
[+]
The problems of reducting, mining, modeling, and presenting data are challenging parts within the data processing and analysis activities. These, contribute to the achievement of high quality data sets which in the end give significance to the experiments, and hence, to the Physics behind.
ICCUB Contribution
The ICCUB’s researchers are engaged since 1998 in the Gaia Data Processing and Analysis Consortium (DPAC) in charge of designing, implementing, managing and running the whole data reduction of the Gaia mission, from the storage of the telemetry to the production of the final catalogue [+]
The ICCUB has important responsibilities in four out of nine coordination units in DPAC: CU2 (simulations), CU3 (core processing), CU5 (photometric processing), CU9 (Catalogue Access) and in the Data Processing Center of Barcelona (comprising BSC and CESCA).
In this framework, the ICCUB also leads the EU FP7 funded initiative named GENIUS (2013-2016), aimed to significantly contribute to the development of the Gaia Archive: use the best state-of-the-art archive system; provision of exploitation tools to maximize the scientific return; ensuring the interoperability with future astronomical archives; and last but not least, the archive facilities outreach activities. Our team has one representative in the Gaia Scientific Team, one in the DPAC Executive, two deputy managers in CU2 and CU3, and leads the CU9.
Based on the expertise of our team on efficient compression systems for space, DAPCOM was created as a spin-off company dedicated to efficient data compression systems.
Lines of Research
- Data reduction of space missions.
- Data compression.
- Data mining.
- Software engineering.
- Parallel processing & massive data.
Members
