Lead Data Engineer

Thoughtworks is a leading technology consultancy that is revolutionizing tech through purposeful and impactful work. They are seeking a Lead Data Engineer to develop modern data architecture approaches and provide end-to-end data solutions while leading data engineering projects and collaborating with stakeholders to leverage data effectively.

Responsibilities:

• You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration
• You will collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality
• You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
• You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems
• You will collaborate with data scientists to design scalable implementations of their models
• You write clean and iterative code based on TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
• You will lead and advise clients on how to use different distributed storage and computing technologies from the plethora of options available
• You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack
• You will be responsible for data governance, data security and data privacy to support business and compliance requirements
• You will define the strategy for and incorporate data quality into your day-to-day work

Requirements:

• You have experience in leading the system design and implementation of technical solutions
• Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems
• You have a deep understanding of data modeling and experience with modern data engineering tools and platforms
• You have experience in writing clean, high-quality code using the preferred programming language
• You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting
• You have experience with data visualization techniques and can communicate the insights as per the audience
• You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems
• You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.)
• You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way
• You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives
• You don't shy away from risks or conflicts, instead you take them on and skillfully manage them
• You coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work
• You enjoy influencing others and always advocate for technical excellence while being open to change when needed
• You are a proven leader with a track record of encouraging teammates in their professional development and relationships
• Cultivating strong partnerships comes naturally to you; You understand the importance of relationship building and how it can bring new opportunities to our business