Data engineering (INFO904_SIAY)
Présentation
The course introduces students to modern technologies used for data processing in the context of Big Data. In particular, the course aims to position the need for parallel processing architectures in the modern data environment. Through examples, students will learn how to implement simple processing pipelines and study the benefit of their usage.
Heures d'enseignement
| Cours Magistral | 12h | |
| Travaux Dirigés | 12h |
Pré-requis obligatoires
Programming skills in Python. Notions of data processing libraries, e.g., NumPy, Pandas, etc. Basic notions of parallel computing.
Plan du cours
- Data engineering 101: data stores and parallel computing
- Big data tools: MapReduce, Hadoop, Spark
- Extract, Transform, and Load pipelines
Compétences visées
- Understanding of big data processing tools
- Ability to implement simple parallel processing pipelines
- Ability to display the results of data processing pipelines
Contacts
