Senior Data Engineer

Role Overview

• Optimize Site Performance: Dynamically deliver personalized content alongside cached assets, improving load times and enhancing user experience with features like page-level deduplication
• Enhance Data Access: Continue to evolve our pipelines to ensure the timeliest access to instrumentation and content data for feature and model development
• Accelerate Experimentation: Partner with our Data & Analytics organization to improve the tooling and coordination involved in A/B testing
• Support Engineering with Foundational Models: As tools like Bedrock emerge, enhance our platform to support them, ensuring we’re prepared for the next generation of AI-powered applications
• Work closely with ML engineering to make data easily accessible and understandable
• Ensure the reliability and minimize the latency of data delivery for ML use cases
• Create transparency in our data pipelines with comprehensive telemetry
• Develop and enforce data engineering, security, data quality standards through automation
• Collaborate with other engineers to develop and enhance core capabilities, infrastructure, and architecture
• Leverage vended and open-source cloud technologies to reduce maintenance costs and improve efficiencies, ensuring our products remain profitable
• Ensure that code is readable, maintainable, scalable, observable, and resilient
• Independently own and execute on projects within your squad
• Collaborate effectively with engineers across the team to deliver projects scale and integrate ML and AI features into the website, mobile app, and editorial tools
• Contribute to the design of components and systems and represent your thoughts in architecture reviews
• Be responsive to incidents and participate effectively in incident retrospectives
• Champion improvements to developer experience, integrations, and testing processes
• Support, coach, mentor, and provide valuable feedback to junior engineers on your squad

Requirements

• 5+ years progressively complex experience designing, building, and shipping products
• 3+ years experience in data engineering roles or backend roles with a data focus
• 2+ years experience building data pipelines with IaC
• 2+ years experience with Python
• 2+ years experience in one of Golang, Java, C++
• 2+ years experience with Kafka or equivalent
• Proficiency with Postgres or equivalent
• Proficiency with DynamoDB or equivalent
• Proficiency with Terraform or equivalent
• Deep understanding of common software data structures and algorithms and experience in modern data engineering technologies and best practices
• A proven track record of building real-time products for web scale that are highly available and performant
• A collaborative mindset, understanding that great results come from teamwork and a positive culture

Tech Stack

• Cloud
• DynamoDB
• Java
• Kafka
• Postgres
• Python
• Terraform
• Go

Benefits

• Career defining opportunities
• Thoughtfully curated benefits