Senior Data Engineer – Databricks Specialist

About the role

At SunnyData we help customers on their data journey by building highly scalable architectures, robust pipelines and AI‑ready data layers. As a Senior Data Engineer with deep Databricks experience you will work directly with internal teams and client stakeholders to design, build and deploy end‑to‑end data solutions that enable machine‑learning, business‑intelligence and analytics.

Key responsibilities

• Support new and existing customers with their data‑engineering needs, guiding technical decisions and tracking project progress.
• Design, build and operationalise complex data pipelines on Databricks, including migration from legacy platforms.
• Analyse data sources, recommend inclusion in analytical processes and apply data‑cleansing and quality improvements.
• Incorporate data‑governance, security and quality standards into all solutions.
• Collaborate across teams to deliver data products, educate end users and resolve moderate‑complexity defects.
• Test data movement, transformation code and performance optimisation techniques.

Required profile

• 7+ years of data‑engineering or data‑product development experience.
• 3+ years in a consulting environment, interacting with customers.
• Bachelor’s degree in Computer Science, Engineering or a related field.
• Strong communication, collaboration and leadership abilities.

Required skills

• Extensive experience with the Databricks platform, including Genie and Apps (plus).
• Proficiency in SQL and PySpark.
• Hands‑on experience with Azure, AWS or GCP cloud services.
• Knowledge of CI/CD pipelines and GenAI concepts.
• Experience with clustering techniques, performance optimisation and data‑migration projects.

What we offer

• Innovative environment working with cutting‑edge data and AI technologies.
• Direct impact on customer businesses through data‑driven insights.
• Opportunities for professional growth and career advancement.
• Collaborative culture that values knowledge sharing.