November 2023 - January 2025 (1 year and 3 months)
Brussel, Belgium
Lead Data engineer
• Context: For the manufacturing department, delivered a data pipeline allowing the optimization of the production process using the continuous and discrete data from the different source systems. This was done using technologies like Terraform, Kedro, Spark, Databricks, Container and Function Apps, Posit Workbench, AzureML, Linux(Ubuntu), Docker
• Responsibilities:
• Data engineering tasks: cleaning, transformation, modelling, coordinating junior DE’s.
• Data analysis tasks: profiling, completeness, quality, visualization.