Pyspark Expertise • Expert proficiency in Pyspark • Ability to design and implement efficient data processing workflows • Experience with Pyspark SQL and DataFrames • Good exposure to Big Data architectures and good understanding of Big Data eco system • Experience with some framework building experience on Hadoop • Good with DB knowledge with SQL tuning experience. • Good to have experience with Python, APIs and exposure to Kafka. • Team Management: Lead and manage a team of technical professionals – Data Engineer and Application Developers, ensuring effective collaboration and productivity. • Client Interaction: Serve as the primary point of contact for clients, understanding their needs and ensuring successful project delivery. • Status Reporting: Prepare and present detailed status reports on ongoing projects to stakeholders, highlighting progress, risks, and mitigation plans. • Issue Resolution: Proactively identify and resolve any technical challenges or roadblocks faced by the team, ensuring smooth project execution. • Project Management: Oversee the entire project lifecycle, from planning to execution, ensuring timely delivery within scope and budget. • Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability • Good knowledge on software configuration management systems • Awareness of latest technologies and Industry trends • Logical thinking and problem solving skills along with an ability to collaborate • Understanding of the financial processes for various types of projects and the various pricing models available • Ability to assess the current processes, identify improvement areas and suggest the technology solutions • One or two industry domain knowledge • Client Interfacing skills • Project and Team management