Key skills
KafkaPostgresPythonGoCI/CD
About this role
Role Overview
- Work closely with firmware and frontend teams to ensure our infrastructure scales to meet these requirements
Requirements
- Working in Go and Python, ensure backwards compatibility and feature versioning across constantly evolving schemas
- Build scalable pipelines for ingesting, transforming, and serving petabytes of data across Kafka, Postgres, and Clickhouse
- Create CI/CD workflows that evolve the API in lockstep with changes to the underlying data schema
- Enable fine-grained querying of historical and real-time data for any network, at any point in time
- Help define and enforce the principle of "smart data, dumb functions": doing as much as possible in the data layer to keep downstream code minimal
- Collaborate with modelers to co-design training and evaluation pipelines that are reproducible, debuggable, and fast
- Own performance across key endpoints to meet real-time serving constraints
Tech Stack
- Kafka
- Postgres
- Python
- Go
Benefits
- Medical, dental & vision insurance coverage for you and your dependents
- Annual memberships to One Medical, Headspace and Wellhub
- 401k (traditional and Roth options available)
- Flexible time off (FTO)
- Commuter reimbursement
- Parental Leave
- In-house chef and onsite meals (San Francisco Office)