Senior Data Engineer – AWS Cloud Platform

About the role

Goods & Services is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines on AWS. You will work closely with analytics engineers, data scientists, and developers to deliver reliable, cost‑efficient data solutions and business‑facing analytical models.

Key responsibilities

• Design, develop, and maintain ETL/ELT pipelines across AWS environments.
• Manage and optimise data platforms using AWS Glue, Redshift, Athena, S3, Glue Data Catalog, Lake Formation, and IAM.
• Orchestrate large‑scale data workflows with Apache Airflow.
• Build and optimise data warehouse solutions and analytical models using dbt, Spark, and SQL.
• Support CI/CD pipelines and deployment automation with CodeBuild, Jenkins, and GitHub Actions.
• Architect and maintain lakehouse storage layers on S3 using Apache Iceberg or Delta Lake.
• Manage Glue Data Catalog crawlers and Lake Formation permissions for data governance.

Required profile

• 5+ years of experience in data engineering or cloud data platforms, with a strong focus on AWS services.
• Hands‑on production experience with Apache Airflow.
• Proven ability to build data warehouse solutions and business‑facing analytics models.
• Strong Python programming skills for ETL/ELT development.

Required skills

• AWS Glue (PySpark)
• Amazon Redshift
• Athena
• Amazon S3
• Glue Data Catalog
• Lake Formation
• IAM
• Apache Airflow
• dbt
• Apache Spark
• SQL
• Python
• Apache Iceberg or Delta Lake