Software Engineer II

Design, build, and operate scalable, reliable backend services that process high-volume, asynchronous AI inference workloads. Develop intelligent scheduling and request-routing capabilities that make efficient, load-aware use of available compute capacity. Improve throughput, latency, and cost efficiency of large-scale workloads through profiling, tuning, and thoughtful system design. Instrument services with strong telemetry, monitoring, and alerting, and participate in on-call rotations to ensure high availability. Partner with product and platform teams to onboard new models and capabilities and to support growing enterprise adoption. Write clean, testable, maintainable code and contribute actively to design discussions and code reviews. Continuously identify and drive improvements in reliability, scalability, and engineering quality. Bachelor's degree in Computer Science or a related technical field AND 3+ years of technical engineering experience, OR equivalent experience. 2+ years of experience designing and building backend or distributed services in a modern programming language such as C#, Java, Go, or C++. 1+ years of experience building and operating services on a public cloud platform such as Azure, AWS, or GCP. 1+ years of experience with large-scale distributed systems, high-throughput data processing, or asynchronous/batch workloads. Experience with scheduling, queueing, load balancing, or request-routing systems. Experience with observability tooling and operating production services in an on-call model. Familiarity with containerized services and orchestration (e.g., Docker and Kubernetes)