DE&A - Core - Cloud Data Engineering - AWS Data Engineering

As a Data Engineer, you will play a crucial role in designing and developing data-driven solutions for our clients. Your expertise in data exploration, Python, SQL Mesh and DuckDB will be utilized to create efficient and scalable data pipelines. With a focus on AWS, you will leverage its data products and services to build robust and secure data architectures. Your role is key in ensuring data integrity, performance, and governance, while also contributing to the overall success of our data-centric projects.

Design and develop data pipelines and architectures using AWS EC2(Linux),Python Scripting, SQL Mesh, Duck DB and Streamlit . Implement data warehouse modeling methodologies, including Star/Snowflake, to ensure efficient data storage and retrieval. Write automated tests for data pipelines to maintain data integrity and quality. Utilize Python and SQL Mesh for ETL development and data wrangling. Collaborate with cross-functional teams to understand business requirements and translate them into technical data solutions. Ensure data governance practices are followed, including the use of AWS SQL Mesh or similar tools. Stay updated with the latest data engineering technologies and best practices, and contribute to the continuous improvement of our data practices. Document and communicate data-related processes and decisions to stakeholders. Troubleshoot and resolve data-related issues, and provide timely support to the team. Actively participate in code reviews and provide constructive feedback to ensure high-quality data engineering work.

Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 8+ years of experience in data engineering or a similar role, with a strong focus on AWS technologies. Proficiency in Python for ETL development and data wrangling, and experience with SQL Mesh & DuckDB . Excellent knowledge of SQL programming, including stored procedures and functions. Experience with data warehouse modeling methodologies. Familiarity with AWS EC2(Linux), Pythn Scripting, SQL Mesh, DuckDB and Streamlit is a must. Strong analytical and problem-solving skills, with the ability to work independently and manage multiple tasks. Excellent communication skills, both written and verbal, to effectively collaborate with cross-functional teams. A proactive and self-motivated attitude, with a passion for data engineering and a desire to stay updated with industry trends. Experience with source control GitHub.