DA Lead Data Engineer

Labcorp is a leader in diagnostics, drug development and healthcare innovation. Across every role, we harness data and AI to work smarter, move faster and create breakthrough solutions that improve health outcomes for people. With our global scale and deep expertise, you'll do meaningful work, grow your career and make a real impact. Together, we're improving health and improving lives.

Labcorp is a global leader in diagnostic testing and drug development solutions, helping healthcare providers, researchers, and patients make informed decisions that advance care. Join us in our mission to improve health and improve lives.

Labcorp is seeking a DA Lead Data Engineer to join our team at Bengaluru, India Office.

Work Schedule

Candidates are required to follow the work schedule from 2:00 PM to 11:00 PM IST.

Job Responsibilities:

- Designing and implementing highly performant data ingestion pipelines from multiple sources

- Delivering and presenting proofs of concept to of key technology components to project stakeholders.

- Developing scalable and re-usable frameworks for ingesting of data sets

- Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times

- Working with event based / streaming technologies to ingest and process data

- Do analysis of new requirements and propose a solution

- Evaluating the performance and applicability of multiple tools against customer requirements

Minimum Qualifications

- Bachelor’s degree in computer science, Engineering, or related field.

- 5 years or more of hands-on experience on PySpark, Python, Spark, Scala, Able to perform data validation, delivery, quality and integrity.

- 5 years or more of Snowflake /Databricks Cloud Data Warehouse Implementation experience, should possess skill pertaining to handling various file formats (XML,JSON,Avro,Parquet)

- 2 years of more experience in Extraction, Transformation and Loading (ETL) data from multiple data sources & various data formats (Structured, Semi-Structured & Unstructured).