Databricks - Principal Data Engineer

Core Responsibilities:

• Databricks Architecture — Design, optimize, and manage end‑to‑end data pipelines using Databricks (Spark, Delta Lake, Unity Catalog).
• ETL/ELT Pipelines — Build scalable ingestion and transformation frameworks for structured and semi‑structured data.
• Cloud Platforms — Implement solutions on Azure/AWS/GCP with strong understanding of compute, storage, and networking.
• Data Warehouse Modernization — Lead migration from legacy systems to modern lakehouse architectures.
• Team Leadership — Mentor engineers, conduct design reviews, and drive delivery excellence.
• Customer Engagement — Lead technical discussions, requirement workshops, and solution walkthroughs.

Required Skills & Qualifications”

• Databricks Expertise: Deep knowledge of Unity Catalog, Photon engine, Databricks SQL, and optimization.
• Cloud Infrastructure: Proven experience architecting scalable data solutions on Azure, AWS, or GCP.
• Data Warehousing: Advanced mastery of ETL/ELT pipeline design, data modeling, and performance tuning.
• Soft Skills: Exceptional analytical thinking, stakeholder management, and clear technical articulation.
• Strong command of Spark, Delta Lake, Python/Scala, SQL, CI/CD, DevOps.
• Experience with large‑scale DWH, performance tuning, and data modeling.
• Proven ability to lead multi‑team delivery in enterprise environments.

• Total Experience: 12 years
• Relevant Experience: 7 years in Databricks and cloud data engineering
• Location: Hybrid
• Employment Type: Full-time