Staff Software Engineer, Batch Data

Tecton is a company that specializes in solving complex data problems in production machine learning. They are seeking a Staff Software Engineer to play a critical role in architecting and scaling core compute engines and storage architecture, contributing to the performance of their query optimizer.

Responsibilities:

• Own and lead significant technical domains starting from the problem definition and technical requirements to implementation and maintenance
• Lead projects of strategic importance to Tecton spanning cross-functional teams, including product management and other engineering teams
• Drive efforts to improve engineering practices, tooling, and processes along with mentorship for junior engineers
• Develop a deep understanding of the fundamental problems our customers face in building ML systems
• Be a generalist as needed. We’re a small, but growing engineering team, and each engineer needs to be versatile

Requirements:

• Experience working in large Python, Java, Kotlin, or Go codebases and running cloud-native Spark systems (e.g. AWS EMR, Databricks, GCP Dataproc)
• Experience in performance tuning of Spark, Ray, Maestro, or Airflow jobs
• Knowledge of data formats such as Parquet, Avro, Arrow, Iceberg, or Delta Lake, and object storage (e.g. S3, GCS)
• Expertise with cloud-scale query performance, query optimization, query planning, heuristic query execution techniques, and cost-driven optimizations
• Experience with internals of distributed systems, SQL/NoSQL databases, data lakes, or data warehouses
• Strong communication skills and ability to write detailed technical specifications
• Excitement about coaching and mentorship of junior engineers
• BSc, MS, or PhD in Computer Science or related fields
• 8+ years of experience in building product software systems