Principal Data Engineer

About the role

NielsenIQ is looking for a Principal Data Engineer to join its Financial Services Engineering team in Mexico City. The team uses alternative datasets to help global public equity investors (hedge funds, mutual funds, pension funds) make better investment decisions. You will help maintain and improve the data platform that supports market research products and data delivered to customers, working with big data and cloud services such as AWS, Azure, Snowflake, Databricks, DBT, Airflow and Looker.

Key responsibilities

• Design, develop and maintain robust, scalable data pipelines for extracting, transforming and loading data from various sources into the data platform.
• Build and extend automation tools for infrastructure provisioning, auto-scaling, code deployment, monitoring, alerting, reporting and failover.
• Collaborate with the engineering and DevOps teams to keep the data platform resilient, highly available and performant.
• Leverage Apache Airflow to orchestrate complex ETL workflows and optimize pipeline performance, troubleshooting issues and validating data quality.
• Stay current with data engineering trends and introduce new technologies and tools.
• Drive the design and implementation of data security and access control policies.

Required profile

• Bachelor's or Master's degree in Computer Science, Data Engineering or a related field.
• 7+ years of experience as a Data Engineer with a strong background in ETL and data warehousing.
• 4+ years of experience with Apache Airflow.
• Ability to work in distributed global teams, in a small team with a start-up mentality, and under pressure.
• Excellent communication with technical and non-technical audiences; English required for interviews.

Required skills

• ETL tools and frameworks such as Apache Spark and Matillion.
• Strong software engineering fundamentals in Python, Java or another relevant language.
• Data modeling, data warehousing and SQL.
• Cloud solutions such as AWS, GCP or Azure.
• Knowledge of data security and encryption is a plus.

What we offer

• Flexible working environment.
• Volunteer time off.
• LinkedIn Learning.
• Employee Assistance Program (EAP).