Big Data Engineer
Hexaware Technologies
Big Query, Cloud Composer, Dataflow, Cloud Storage, Data Transformation, Data Modeling, Data Ingestion, Python, SQLGCP Data EngineerTSR: Big Data Engineer Location: IndiaPrimary Skills: Big Query, Cloud Composer, Dataflow, Cloud Storage, Data Transformation, Data Modeling, Data Ingestion, Python, SQLSecondary Skills: Teradata, Informatica, BTEQ Scripts.We are seeking a skilled GCP Data Engineer to support the modernization of legacy data warehouse and ETL systems into a scalable and cloud-native architecture on Google Cloud Platform (GCP). The role involves designing, developing, and maintaining data pipelines for migration, ensuring data accuracy, performance, and operational reliability.Responsibilities:• Design, develop, and implement ETL/ELT pipelines on GCP using BigQuery, Cloud Composer (Airflow), Dataflow, and Cloud Storage.• Analyze and convert Teradata SQL and BTEQ batch scripts into BigQuery queries and Python-based GCP pipelines.• Build and maintain batch processing workflows aligned with modern cloud-native best practices.• Develop orchestration workflows in Cloud Composer to replace legacy Control-M schedules.• Perform data migration activities including ingestion, transformation, and loading into BigQuery.• Execute unit testing, data validation, reconciliation, and support System Integration Testing (SIT).• Optimize BigQuery queries and pipelines for performance, scalability, and cost efficiency.• Develop pipeline, troubleshoot failures, and ensure production stability.• Collaborate with data architects, leads, SMEs, and DevOps teams to ensure successful delivery.• Support architecture reviews, assessments, risk mitigation planning, and technical governance throughout the migration lifecycle.• Document pipeline logic, transformation rules, and operational procedures for maintainability.Qualifications:• 5+ years of experience in
Don't want to miss the next one?
Subscribe to daily email alerts for roles matching your interests.