Senior Data Engineer - Lakehouse Platform

About the role

Arkham Technologies, a Data & AI Platform provider, is looking for a Senior Data Engineer in Mexico City to own its high-performance Data Platform built on Lakehouse architecture. The engineer works with Apache Spark, Trino and Delta Lake to ensure data governance and interoperability across platforms, and shapes the data infrastructure across the entire lifecycle, from ingestion to transformation and activation.

Key responsibilities

• Lead the next phase of the Data Platform, developing and enhancing it according to Lakehouse principles while ensuring data governance.
• Design and implement pipelines that extract data from structured, semi-structured and unstructured sources.
• Create, monitor and optimize multiple data extraction and transformation pipelines.
• Ensure interoperability between data catalogs and various query engines.
• Oversee cluster performance and implement observability solutions so data pipelines run optimally.
• Maintain high data quality and usability across integration, transformation and activation stages.

Required profile

• 5+ years of experience in data engineering, data architecture or a related field.
• Excellent analytical and debugging skills.

Required skills

• Apache Spark, Delta Lake and Trino.
• Python for scripting and automation.
• AWS services, including Glue, S3 and EMR.
• Understanding of distributed data systems and query engines.