Consultant | Databricks | Kolkata | Engineering | Data Modernization & Migration

Technology & Transformation

EAD: Engineering – Databricks

Your potential, unleashed.

India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond.

At Deloitte, your whole self to work, every day. Combine that with our drive to propel with purpose and you have the perfect playground to collaborate, innovate, grow, and make an impact that matters.

The Team Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.

We are seeking highly skilled Databricks Data Engineers to join our data modernization team. You will play a pivotal role in designing, developing, and maintaining robust data solutions on the Databricks platform. Your experience in data engineering, along with a deep understanding of Databricks, will be instrumental in building solutions to drive data-driven decision-making across a variety of customers. Mandatory Skills: Databricks, Spark, Python / SQL Responsibilities · Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake. · Build and maintain scalable and efficient data processing workflows using Spark (PySpark or Spark SQL) by following coding standards and best practices. · Collaborate with technical and business stakeholders to understand data requirements and translate them into technical solutions. · Develop data models and schemas to support reporting and analytics needs. · Ensure data quality, integrity, and security by implementing appropriate checks and controls. · Monitor and optimize data processing performance, identifying, and resolving bottlenecks. · Stay up to date with the latest advancements in data engineering and Databricks technologies. Qualifications · Bachelor’s or master’s degree in any field · Your experience in designing, implementing, and maintaining data solutions on Databricks · Experience with at least one of the popular cloud platforms – Azure, AWS or GCP · Experience with ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes · Knowledge of data warehousing and data modelling concepts · Experience with Python or SQL · Experience with Delta Lake · Understanding of DevOps principles and practices · Excellent problem-solving and troubleshooting skills · Strong communication and teamwork skills Your role as a leader At Deloitte India, we believe in the importance of leadership at all levels. We expect our people to embrace and live our purpose by challenging themselves to identify issues that are most important for our clients, our people, and for society and make an impact that matters. In addition to living our purpose, Consultant across our organization: Develop high-performing people and teams through challenging and meaningful opportunities