Director | AI / ML | Bengaluru | Engineering | Hybrid Cloud Engineering at Deloitte South Asia · HyrikoBack to jobsvia Career pages·2w ago
Director | AI / ML | Bengaluru | Engineering | Hybrid Cloud Engineering
Deloitte South Asia
Full-timeOn-site
Location:Bengaluru, IndiaType:Full-timePosted:2w ago Your work profile
- AI Data Center Architecture & Solution Design
- Design and implement AI-focused Data Center architectures aligned with Tier II, Tier III, and Tier IV standards.
- Develop end-to-end AI Data Center solutions, including retrofitting traditional CPU-based data centers into AI Factories.
- Create advisory documents, RFPs, technical proposals, and commercial proposals for AI Data Center engagements.
- Design AI infrastructure solutions across hyperscalers (AWS, Azure, GCP, OCI) and NVIDIA Cloud Partners.
- Prepare HLDs, LLDs, network diagrams, rack layouts, BOQs, and TCO models.
- AI Networking & Fabric Architecture
- Architect and deploy InfiniBand and NVIDIA Spectrum Ethernet fabrics for AI workloads.
- Design and implement Spine-Leaf network architectures using EVPN-VXLAN overlays.
- Configure and optimize BGP, ECMP, RoCE, and high-performance networking environments.
- Lead Cumulus Linux-based deployments and network automation initiatives.
- Optimize network performance, latency, throughput, and congestion management for AI environments.
- AI Compute & GPU Infrastructure
Don't want to miss the next one?
Subscribe to daily email alerts for roles matching your interests.
Design and size GPU clusters using NVIDIA H100, H200, B200, B300, DGX, and AI Factory platforms.- Perform GPU capacity planning and workload profiling for AI and ML use cases.
- Implement GPU virtualization and Multi-Instance GPU (MIG) architectures.
- Support AI training and inference infrastructure deployments.
- AI Storage & Platform Engineering
- Design AI storage solutions utilizing NAS, SAN, NVMe, Object Storage, NFS, iSCSI, Fibre Channel, and parallel file systems.
- Implement and manage Kubernetes-based AI platforms, including OpenShift and VMware Tanzu.
- Deploy and integrate RUN and Slurm workload schedulers for GPU orchestration.
- Ensure seamless integration of AI platforms with existing enterprise infrastructure.
- Monitoring, Observability & Operations
- Implement NVIDIA UFM, NVIDIA Mission Control, and NetQ for infrastructure monitoring and observability.
- Configure telemetry, validation, troubleshooting, and fabric management workflows.
- Drive infrastructure benchmarking, performance optimization, and capacity planning initiatives.
- Support POCs, design validation exercises, production rollouts, and operational readiness activities.
- Design AI infrastructure solutions across AWS, Azure, GCP, and OCI.
- Enable AI services integration across hybrid and multi-cloud environments.
- Provide guidance on AI platform adoption, scalability, and operational best practices.
Data Center Infrastructure
- Strong understanding of Data Center power infrastructure, including UPS, PDU, ATS, switchgear, transformers, and generators.
- Knowledge of Data Center cooling technologies such as CRAC, CRAH, liquid cooling, immersion cooling, and chiller systems.
- Experience in rack design, cabling architecture, white space planning, and physical infrastructure design.
- Understanding of raised floors, fire suppression systems, plenum design, and facility infrastructure.
- Strong expertise in InfiniBand (HDR/NDR), RoCE, and Ethernet fabrics.
- Hands-on experience with NVIDIA Spectrum switches.
- Deep understanding of EVPN-VXLAN, BGP, ECMP, Spine-Leaf architecture, and network automation.
- Experience with Cumulus Linux environments.
- Expertise in NVIDIA GPU platforms including DGX, H100, H200, B200, and B300.
- Experience with GPU virtualization, MIG, and AI workload optimization.
- Strong understanding of AI training and inference infrastructure.
- Knowledge of AI storage architectures and parallel file systems such as Lustre and GPFS.
- Experience with NAS, SAN, Fibre Channel, NVMe, NFS, iSCSI, and Object Storage technologies.
Orchestration & Container Platforms
- Experience with Kubernetes ecosystems.
- Hands-on expertise with OpenShift and VMware Tanzu.
- Experience with RUN and Slurm workload management platforms.
- Understanding of container networking for AI workloads.
- Understanding of AI infrastructure software layers including:
- Training and Inference Frameworks
- NVIDIA NVIS
- Strong understanding of AWS, Azure, GCP, and OCI services.
- Experience designing AI and cloud-native solutions in hyperscaler environments.
Similar roles you might like
More openings like this one — take a look before you go.
Browse all jobsapex classes
