Software Engineer, Batch Data

Tecton is a company focused on solving complex data problems in production machine learning. The Senior Software Engineer on the Batch Data team will be responsible for architecting, designing, and scaling core compute engines and storage architecture to enhance the performance of Tecton's feature platform.

Responsibilities:

• Own and lead significant technical domains starting from the problem definition and technical requirements to implementation and maintenance
• Lead projects of strategic importance to Tecton spanning cross-functional teams, including product management and other engineering teams
• Drive efforts to improve engineering practices, tooling, and processes along with mentorship for junior engineers
• Develop a deep understanding of the fundamental problems our customers face in building ML systems
• Be a generalist as needed. We’re a small, but growing engineering team, and each engineer needs to be versatile

Requirements:

• Experience working in large Python, Java, Kotlin, or Go codebases and running cloud-native Spark systems (e.g. AWS EMR, Databricks, GCP Dataproc)
• Experience in performance tuning of Spark, Ray, Maestro, or Airflow jobs
• Knowledge of data formats such as Parquet, Avro, Arrow, Iceberg, or Delta Lake, and object storage (e.g. S3, GCS)
• Expertise with cloud-scale query performance, query optimization, query planning, heuristic query execution techniques, and cost-driven optimizations
• Experience with internals of distributed systems, SQL/NoSQL databases, data lakes, or data warehouses
• Strong communication skills and ability to write detailed technical specifications
• Excitement about coaching and mentorship of junior engineers
• BSc, MS, or PhD in Computer Science or related fields
• 8+ years of experience in building product software systems