We are seeking a skilled DevOps Engineer with experience in AI/ML infrastructure to design, build, and maintain scalable, secure, and reliable cloud platforms that support AI and machine learning workloads. The ideal candidate will have strong expertise in cloud-native technologies, CI/CD, infrastructure automation, Kubernetes, and MLOps practices.
Key Responsibilities:
- Design, implement, and manage cloud infrastructure for AI/ML applications and services.
- Build and maintain CI/CD pipelines for application and machine learning model deployments.
- Automate infrastructure provisioning using Infrastructure as Code (IaC) tools.
- Deploy and manage containerized workloads using Kubernetes.
- Implement MLOps workflows for model training, validation, deployment, and monitoring.
- Optimize cloud resources for performance, scalability, and cost efficiency.
- Monitor platform health, troubleshoot production issues, and ensure high availability.
- Implement security best practices, including secrets management, IAM, and compliance controls.
- Collaborate with data scientists, ML engineers, software developers, and platform teams.
- Establish observability solutions using logging, monitoring, and tracing tools.
Required Skills:
DevOps & Cloud
- Strong experience with at least one major cloud platform:
- Amazon Web Services (AWS)
- Microsoft (Azure)
- Google (GCP)
- Expertise in Linux system administration.
-
Experience with containerization technologies such as:
- Docker
Don't want to miss the next one?
Subscribe to daily email alerts for roles matching your interests.
- Experience supporting AI/ML workloads in production.
-
Knowledge of MLOps frameworks and tools:
- MLflow
- Kubeflow
- Experience with model deployment, model serving, and monitoring.
- Understanding of GPU-based infrastructure and distributed training environments.
- Familiarity with vector databases, LLM applications, and generative AI workflows.
- Experience integrating AI services and APIs.
Monitoring & Security
-
Monitoring and observability:
- Prometheus
- Grafana
- OpenTelemetry
-
Security and secrets management:
- HashiCorp Vault
- Knowledge of DevSecOps practices.
Preferred Qualifications:
- Experience with Large Language Models (LLMs) and Generative AI platforms.
- Experience with Retrieval-Augmented Generation (RAG) architectures.
- Certifications in AWS, Azure, GCP, Kubernetes, or Terraform.
- Experience managing multi-cloud or hybrid-cloud environments.
Nice-to-Have:
- Python scripting and automation.
- Experience with data pipelines and streaming technologies.
- Knowledge of cost optimization for AI infrastructure.
- Experience building internal developer platforms and self-service infrastructure.
Success Criteria
- Highly available and secure AI/ML platform.
- Automated deployment pipelines for applications and models.
- Reduced infrastructure provisioning time through automation.
- Improved reliability, observability, and operational efficiency of AI workloads.
Why this job is important to us
The team you will be joining is a part of Charles River Development (or CRD), that became a part of State Street in 2018. CRD helps create enterprise investment management software solutions for large institutions in the areas of institutional investment, wealth management, and hedge funds. Together we have created the first open front-to-back platform - State Street Alpha, that was launched in 2019.
Why this job is important to us
The team you will be joining is a part of Charles River Development (or CRD), that became a part of State Street in 2018. CRD helps create enterprise investment management software solutions for large institutions in the areas of institutional investment, wealth management and hedge funds. Together we have created the first open front-to-back platform - State Street Alpha, that was launched in 2019.
Responsibilities:
- Strong experience in enterprise application architecture and platform‑based solution design.
- Demonstrated ability to deliver complex platforms into production, not just define architecture.
- Drive technical excellence by working to analyse, design, develop, test, and debug large and complex software enhancements and solutions within Charles River’s business and technical problem domains including modifications to core frameworks and other primary facilities critical to system operation
- Collaborate with Business Analysts and Product Managers to create simple and sustainable software solutions for complex problems
- Provide thought leadership in the design of product architecture within and beyond the team’s scope of responsibility
- Direct problem solving for projects or major phases of projects to resolve advanced software technical issues
- Develop, test, debug, and implement software programs, applications and projects using Java, C#, SQL, JavaScript, or other related software engineering languages as well as keeping abreast of emerging technologies impactful to CRDs business
- Provide informed guidance and critical analysis of proposed changes during code reviews
- Write unit and automation tests to ensure a high-quality end product
- Contribute to written design and API documentation, and participate in customer documentation process
- Identify ways of improving development test methodologies contribute to and related test methodology frameworks
- Develop automate test and conduct manual tests to ensure a high-quality product
- Provide expert level troubleshooting on large, mission critical client implementations
- Actively assist team leaders in the agile software development process by adhering to and advancing the CRD scrum methodology, including attending all daily standups, sprint planning, backlog grooming, and retrospectives
- Plan and coordinate cross-team activities groups to complete assignments
Preferred qualifications and education:
- B.S. degree (or foreign education equivalent) in Computer Science, Engineering, Mathematics, and Physics or other technical course of study required. MS degree strongly preferred.
Experience:
- Experience with the Spring Boot Microservices and familiarity with the service deployment in cloud environments.
- A minimum of 12 years of progressively responsible professional software engineering experience
- Ideally, a minimum of 3 years of experience in financial services developing solutions for Portfolio Management, Trading, Compliance, Post-Trade, IBOR or Wealth Management is strongly desired
- Authoritative experience with object-oriented programming, compiler or interpreter technologies, embedded systems, operating systems, relational databases (RDBMS), scripting and new/advanced programming languages
- Experience in the development of cloud-native services (Azure experience a bonus)
- Experience of microservice architectures and Kubernetes
- Knowledge and experience working with Kafka and message-based systems
- Experience with Snowflake will be a strong asset.
- Experience with Postgres SQL is preferred
- Demonstrated problem solving abilities involving multi-tiered, high-performance database applications
- Demonstrated ability to design and develop simple software solutions to business and technical problems of high complexity
- Outstanding written and verbal communication skills
- Able to work well with peers in a collaborative team environment
- A minimum of 3 years working with an Agile development methodology
About Charles River Development:
Charles River Investment management System in a platform that provides many Front-Office functions including Portfolio Management, Order Management and Execution, Compliance, Performance & Attribution, Modelling, Scenario Analy
Similar roles you might like
More openings like this one — take a look before you go.
