Key skills
Amazon RedshiftAWSBigQueryCloudDistributed SystemsKafkaPulsarPythonTerraformMachine LearningAnalyticsSnowflakeRedshiftGoogle CloudCommunication
About this role
Role Overview
- Play a critical role in defining the technical direction and leading the development of the retrieval platform to power next-gen systems at Whatnot.
- Responsible for driving innovation, ensuring the scalability and performance of systems.
- Work with a team of engineers to deliver high-quality solutions.
- Make key decisions about integrating data systems at Whatnot.
- Align efforts to optimize other aspects of the company’s architecture, such as machine learning, real-time analytics, stream processing, and content understanding.
Requirements
- 3+ years of experience
- Ability to write well-tested, API-driven applications and services that run at scale in production.
- Track record of building scalable and performant distributed systems
- Expertise in managing cloud data stores (Snowflake, BigQuery, Redshift, etc.) for processing and serving data products
- Expertise in streaming data systems such as Kafka, Flink, or Pulsar, and the ability to design and manage real-time processing pipelines at scale.
- Strong experience supporting operational systems to ensure uptime, reliability, and maintainability, including monitoring, alerting, and incident management.
- Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (e.g. Terraform).
- Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles.
- Self-starter ethic, thriving under a high level of autonomy.
- Exceptional interpersonal and communication skills.
Tech Stack
- Amazon Redshift
- AWS
- BigQuery
- Cloud
- Distributed Systems
- Kafka
- Pulsar
- Python
- Terraform
Benefits
- Generous Holiday and Time off Policy
- Health Insurance options including Medical, Dental, Vision
- Work From Home Support
- Home office setup allowance
- Monthly allowance for cell phone and internet
- Care benefits
- Monthly allowance for wellness
- Annual allowance towards Childcare
- Lifetime benefit for family planning, such as adoption or fertility expenses
- Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
- Monthly allowance to dogfood the app
- Parental Leave
- 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.