We are looking for a highly skilled Senior Databricks Engineer to contribute to the engineering, modernization, and continuous evolution of data processing platform on Databricks on AWS. While supporting the transition from the legacy Cloudera Hadoop platform to Databricks on AWS, this role will continue to play a key part in enhancing performance, simplifying pipelines, and delivering new capabilities on the Databricks platform over the long term.
The ideal candidate is a strong hands‑on Spark engineer with solid design experience, capable of contributing to architectural decisions while leading complex implementation and optimization efforts.
Responsibilities:
Platform Engineering & Modernization
Refactor and modernize existing Spark pipelines to Databricks native architectures
Eliminate legacy Hadoop dependencies and adopt cloud native AWS patterns
Enhance and extend existing processing logic using optimized Spark (JavaSpark / PySpark) on Databricks
Databricks Native Development
Build and optimize solutions using Databricks features, including Delta Lake, Databricks Workflows for orchestration and Auto scaling and job clusters
Design & Solution Engineering
Contribute to low and mid level architecture and design
Translate high level architecture into detailed technical designs
Define data models, pipeline patterns, and reusable components
Don't want to miss the next one?
Subscribe to daily email alerts for roles matching your interests.
Applications Development ------------------------------------------------------
Time Type:
Full time ------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above. ------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter. ------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.
Similar roles you might like
More openings like this one — take a look before you go.
