Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.
Your work profile
Apache Flink Infrastructure Expert
As a Cloud Data Platform Expert on the Public Cloud team, you will lead the core architecture of our streaming infrastructure.
Our team's mission is to evolve our application and data hosting environments into an integrated, hybrid multi-cloud ecosystem leveraging AWS and Google Cloud. You will focus heavily on designing, provisioning, managing, and scaling distributed Apache Flink clusters on cloud-native environments.
You will empower application developers with self-service streaming capabilities, infrastructure-as-code, and codified blueprints to accelerate stream processing from idea to production.
Platform Architecture: Design, build, and operate resilient, scalable, and secure Apache Flink platform clusters across AWS and GCP.
Cloud Infrastructure Provisioning: Deploy and manage Flink clusters on cloud environments using Kubernetes (EKS/GKE) utilizing session, application, or per-job deployment models.
Don't want to miss the next one?
Subscribe to daily email alerts for roles matching your interests.
Infrastructure as Code (IaC): Develop and manage underlying cloud infrastructure using IaC principles and tools such as Terraform and Ansible to ensure automated, repeatable cluster provisioning.
Operational Excellence & Tuning: Take ownership of the Flink platform lifecycle, including high availability (HA) configurations, state backend management (RocksDB), autoscaling, and savepoint strategies.
Risk, Security & Control: Ensure the streaming platform adheres to technology standards and risk management frameworks. Implement security controls, Kerberos, IAM, network isolation, and encryption for Flink environments.
CI/CD & Platform Automation: Implement and maintain CI/CD pipelines to automate Flink operator installations, Kubernetes deployments, and cluster upgrades.
Observability & Monitoring: Define cluster telemetry and implement production-grade metrics, logs, and alerts for JobManagers, TaskManagers, and JVM behaviors.
Collaboration & Blueprints: Create codified blueprints and automated self-service paths to reduce duplication, enabling developers to deploy Flink code with ease.
Proven experience as a Platform Engineer, Cloud Infrastructure Engineer, or Data Platform Architect in a mid-level or senior capacity.
Expert knowledge setting up, scaling, and managing Apache Flink clusters natively on cloud resource managers.
Hands-on experience with public cloud platforms, specifically AWS and/or Google Cloud (GCP).
Containerization Technologies: Expert-level proficiency in Docker and container orchestration platforms like Kubernetes (e.g., Amazon EKS, Google GKE).
Infrastructure-as-Code: Demonstrable knowledge of IaC tools such as Terraform and/or Ansible for distributed data system cluster management.
Strong architectural skills with a focus on building well-engineered, fault-tolerant, and resilient platform foundations.
Experience with automated platform validation and verification testing frameworks.
Understanding of Site Reliability Engineering (SRE) practices in a platform infrastructure ownership model.
Key skills required:
Public cloud provider certifications (e.g., AWS Certified DevOps Engineer, Google Cloud Professional Cloud Architect).
Strong proficiency in one or more programming languages (Python, Java, Go) to build custom platform tooling.
Experience with Managed Services for Flink (e.g., Amazon Managed Service for Apache Flink / Kinesis Analytics, Confluent Cloud Flink).
Familiarity with cloud-native CI/CD tools and platforms like Harness, Tekton, or Jenkins.
Knowledge of core networking, security, VPC peering, and identity/access management (IAM) in a cloud environment.
Experience with monitoring and observability tools (e.g., Prometheus, Grafana, ELK stack).
Qualifications
B.E / B.Tech / BCA/ MCA in Computer Science, Engineering or a related subject
Similar roles you might like
More openings like this one — take a look before you go.
