Staff Software Engineer (Data Engineer)

Plume is a pioneering company that has built the world's first open and hardware-independent service delivery platform for smart homes and businesses. They are seeking a Staff Software Engineer to join their Data Services team, responsible for building and operating data pipelines that support Plume's products and analytics at scale.

Responsibilities:

• Partner with stakeholders to define data requirements and translate them into robust pipeline designs
• Build and maintain high-quality data pipelines with strong reliability and data integrity standards
• Own data warehouse schema documentation and keep it current as systems evolve
• Write clean, well-structured code and contribute to a culture of rigorous peer review
• Continuously refactor and optimize pipelines for performance, cost efficiency, and operational simplicity
• Triage and resolve production issues related to data quality and availability
• Mentor junior engineers and new hires, helping them ramp up quickly and contribute confidently
• Uphold data governance requirements including access controls, retention policies, residency rules, and de-identification
• Contribute to the technology roadmap and drive best practice adoption across the team
• Orchestrate complex workflows in Apache Airflow writing DAGs, managing dependencies, and building in automated error handling
• Implement granular access controls and data security policies using AWS Lake Formation
• Integrate automated data quality checks into deployment pipelines so issues are caught before they reach production

Requirements:

• 5+ years of software development experience building, scaling, and supporting production data pipelines
• Hands-on expertise with AWS big data services particularly Athena for distributed querying and Lake Formation for security, cataloging, and access management
• Solid Apache Airflow experience: writing DAGs, managing task dependencies, and debugging runtime failures
• A DataOps mindset comfortable with CI/CD for pipelines, environment monitoring, IAM/permissions management, and owning what you ship
• Strong Python skills for scripting, automation, and Airflow orchestration; proficiency in Java or Scala for core pipeline development
• High proficiency in SQL across data warehousing technologies
• Deep understanding of large-scale data processing frameworks, preferably Apache Spark (Flink experience a plus)
• Solid grasp of data warehousing concepts and design patterns
• Strong analytical thinking and clear, effective communication written and verbal