Systems Research Engineer, GPU Programming

As a Systems Research Engineer specialized in GPU Programming, you will play a crucial role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. Working closely with the modeling and algorithm team, you will co-design GPU kernels and model architecture to enhance the performance and efficiency of our AI systems. Collaborating with the hardware and software teams, you will contribute to the co-design of efficient GPU architectures and programming models, leveraging your expertise in GPU programming and parallel computing. Your research skills will be vital in staying up-to-date with the latest advancements in GPU programming techniques, ensuring that our AI infrastructure remains at the forefront of innovation.

Requirements

• Strong background in GPU programming and parallel computing, such as CUDA and/or Triton.

• Knowledge of ML/AI applications and models

• Knowledge of performance profiling and optimization tools for GPU programming

• Excellent problem-solving and analytical skills

• Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or equivalent practical experiences

Responsibilities

• Optimize and fine-tune GPU code to achieve better performance and scalability

• Collaborate with cross-functional teams to integrate GPU-accelerated solutions into existing software systems

• Stay up-to-date with the latest advancements in GPU programming techniques and technologies

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.