Design, build, and evolve high-throughput data pipelines that ingest and transform large volumes of unstructured content into structured and enriched datasets
Drive technical direction and architectural decisions across ingestion systems, ensuring scalability, reliability, and long-term maintainability
Improve data quality, correctness, and enrichment workflows to support downstream systems such as Search and Data Science
Build and operate distributed, event-driven systems and streaming pipelines with strong observability and fault tolerance
Partner cross-functionally with Product, Data Science, Search, and Platform teams to deliver high-quality data that powers customer-facing features
Mentor and support engineers through code reviews, technical guidance, and knowledge sharing, raising the overall engineering bar
Identify and lead high-impact technical initiatives, balancing speed of delivery with system stability and long-term health

8+ years of professional experience as a software engineer
Experience designing, building, and operating distributed systems, data pipelines, or event-driven architectures at scale
Strong proficiency in Python or a similar backend programming language
Experience building and maintaining microservices that are reliable, observable, and scalable
Experience working with streaming technologies such as Kafka, Kinesis, or similar systems
Experience with APIs and service communication patterns such as gRPC and Protocol Buffers
Experience working with large-scale data systems or high-throughput SaaS platforms
Expertise with relational or search databases such as MySQL, Postgres, Elasticsearch, or OpenSearch
Experience making technical tradeoffs in distributed systems related to performance, reliability, and maintainability

Comprehensive medical, dental, vision, disability, and life insurance for employees and dependents
100% premium coverage for individuals on high-deductible plans
24/7 Virtual Care and Employee Assistance Program
Employer-funded HSA contributions and other pre-tax benefits
Quarterly wellness stipend and free Headspace subscription
4+ weeks of PTO, plus paid sick and mental health days
13 paid holidays with the option to swap for personal days
Up to 16 weeks of fully paid parental leave
Transparent pathways for internal mobility and promotion
Bi-annual performance reviews, team workshops, and leadership training
Unlimited access to Coursera and O’Reilly
2 additional PTO days annually for learning and development
Home office stipend, phone and internet reimbursement, coworking membership
Virtual and in-person team bonding (lunches, events, competitions)

Lead Software Engineer, Content Ingestion

Key skills