Staff Software Engineer Data - DC Tech Lead

Afresh is an AI platform for grocery that focuses on reducing food waste. The Staff Data Engineer will lead the development of data integrations for distribution center products, designing ETLs and collaborating with cross-functional teams to enhance customer onboarding and data solutions.

Responsibilities:

• Design, build, and optimize robust ETLs using PySpark and DBT to process large-scale customer datasets while developing tools and frameworks to streamline data integrations and improve scalability
• Define the technical vision for DC data architecture, mentor engineers, and manage external contractors to ensure the team delivers high-quality, practical solutions for current and future needs
• Partner with product, engineering, and applied science teams to scope work and deliver data solutions that address real-world challenges in customer data quality and product feature requirements

Requirements:

• Significant experience designing and maintaining ETLs that process large-scale datasets
• Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT
• 2+ years experience in a technical lead role (e.g. Tech Lead or Engineering Manager), with a willingness to mentor and help others grow
• Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions
• A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done
• Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them
• A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort
• Excellent communication skills—you're able to explain your ideas clearly to both technical and non-technical audiences