Lead Data Engineer

Location: Hyderabad, TG, IN

As a Lead Data Engineer, you will be responsible for a team of data engineers in designing and implementing complex data pipelines and analytics solutions to support key decision-making business processes.

You will be expected to take end-to-end ownership of technical deliverables, gaining a full understanding of the data and the underlying business logic required to deliver the solutions.

Key responsibilities include:   

• Work closely with Product Owners and business analysts to understand requirements, formulate solutions, and evaluate the implementation effort.
• Design, develop and maintain scalable data transformation pipelines.
• Data model Design, Data architecture implementation
• Deliver scalable data solutions leveraging PySpark, Python and enterprise data platforms
• Evaluate new capabilities of the analytics platform, develop prototypes, and contribute to building a single source of truth for our application landscape.
• Collaborate within a global development team to design and deliver solutions
• Assist stakeholders with data-related functional and technical issues
• Working with data governance platform for data management and stewardship.

About the Financial planning solutions team:

Our team plays a critical role in delivering IT solutions and supporting business units across the organization. We are dedicated to enhancing financial planning tools and processes, ensuring they’re scalable and adaptable to meet the evolving needs of the business. Collaboration, transparency, and creativity are at the core of how we work, and you’ll find a supportive environment that encourages idea-sharing and mutual respect.

About You:

You will work as a member of our dynamic financial planning team. Your work will have a direct impact on streamlining processes, improving system functionality, and enabling data-driven decision-making across the business. You enjoy the challenge of solving complex big data analytics problems using state-of-the-art technologies as part of a growing global team of data engineering professionals. You are a self-starter with strong problem-solving skills and capable of owning and implementing solutions from start to finish.

Key qualifications include: 

• Bachelor's degree level or equivalent in Computer Science, Data Science or related field.
• ~12+ of experience working with large-scale software systems.
• Strong expertise in PySpark (minimum 3 years, preferably more) and SQL (Spark SQL preferred).
• Proven experience designing and delivering large-scale data engineering solutions on enterprise data platforms and distributed computing (Spark/Hive/Hadoop preferred).
• Solid understanding of data management fundamentals, including data modeling, ETL, data lakes, and warehousing.
• Experience with Scrum/Agile development methodologies
• Strong analytical and problem-solving skills; self-starter with a positive attitude and ability to manage own workload.
• Proven experience working with a diverse multi-location team of internal and external professionals
• Proven experience leading and mentoring engineers, fostering technical growth and knowledge sharing.
• Excellent interpersonal and communication skills, with the ability to engage business stakeholders, justify architectural decisions, and explain complex technical solutions in clear business terms.
• Ability and enthusiasm to work in a global and multicultural environment
• Knowledge of Insurance Domain, Financial Industry or Finance function in other industries is a strong plus