Software Engineer, Ingestion Platform

Reddit is hiring a Software Engineer for its Ingestion Platform team within the Data Platform group. The role focuses on building and improving scalable, fault-tolerant, self-service systems for processing and orchestrating batch and streaming data workloads.

Responsibilities:

• Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads, with a focus on availability, scalability, latency, correctness, and cost efficiency
• Contribute to the architecture and evolution of the platform’s control plane and data plane, including pipeline APIs, controllers, connectors, target managers, schemas, and sink integrations
• Expand the platform beyond Kafka-to-BigQuery by helping deliver production-ready paths to S3/GCS and Apache Iceberg, as well as transformations, deduplication, dead-letter queues, and other reusable capabilities
• Build high-quality connectors and abstractions for systems such as Kafka, BigQuery, S3, GCS, Iceberg, Flink, and other data stores, while keeping the platform modular and easy to extend
• Improve the self-service experience for platform users through clear APIs, safe defaults, automated provisioning, documentation, onboarding workflows, and actionable observability and alerting
• Lead migrations from bespoke and legacy ingestion systems to the Ingestion Platform, partnering with teams such as Ads Data Platform and ML Indexing to make migrations safe, incremental, and low-touch
• Establish strong reliability, security, and operational practices for pipelines running across Kubernetes clusters, including schema evolution, workload identity, permissions, deployment safety, monitoring, and incident response
• Identify gaps in the platform’s architecture and product experience, and lead redesigns that improve developer velocity and enable Reddit’s continued growth
• Work collaboratively with engineers and stakeholders across Infrastructure, Data Platform, Product, Ads, ML, Storage, and partner teams to align roadmaps and deliver durable solutions

Requirements:

• 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code
• Proficient in object-oriented programming languages like Python, Scala, Go, or Java
• Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects
• Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure
• Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context