Software Engineer, Ingestion Platform

Reddit is a community-driven technology company serving millions of users through online communities and large-scale data systems. The Software Engineer, Ingestion Platform will build and improve scalable, fault-tolerant data movement infrastructure supporting batch and streaming processing, machine learning, analytics, and self-service data workflows.

Responsibilities:

• Refine and maintain our data infrastructure technologies to support ML and analytics workflows on data collected from hundreds of millions of users
• Own the Data Movement Platform used to enable batch and stream data processing at Reddit
• Invest in building new infrastructure for Spark, Flink, and Airflow technologies at Reddit, including contributing to the open source community as needed
• Build automated solutions to minimize toilsome work for data users at Reddit and provide a declarative, self-service experience for working with data
• Collaborate with teammates to share on-call responsibilities and support monitoring/alerting to improve the reliability, scalability, latency, and efficiency of Reddit’s Data Platform

Requirements:

• 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code
• Proficient in object-oriented programming languages like Python, Scala, Go, or Java
• Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects
• Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure
• Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context