Data Engineering I

This course gives an introduction to the challenges involved in the analysis of datasets that are so large that it is no longer possible to handle them using traditional databases and traditional software. Such datasets can for example be generated from experiments and simulations in science or the social sciences. A common problem in large-scale machine learning is transforming and computing features from massive datasets as preprocessing to model training. The course covers how modern systems are designed to scale well with respect or performance, robustness and economy. It also gives a hands-on introduction to commonly used frameworks. The focus is on batch analysis and the practical use of cloud computing resources.