Home
Jobs
Saved
Resumes
Staff Data Engineer at Laurel | JobVerse
JobVerse
Home
Jobs
Recruiters
Companies
Pricing
Blog
Jobs
/
Staff Data Engineer
Laurel
Website
LinkedIn
Staff Data Engineer
San Francisco, New York, United States of America
Full Time
1 hour ago
$200,000 - $250,000 USD
H1B Sponsor
Apply Now
Key skills
Airflow
AWS
Django
Docker
Kafka
Kubernetes
MongoDB
Postgres
Python
Terraform
AI
Machine Learning
ML
Large Language Models
Snowflake
SQS
PostgreSQL
Event Streaming
About this role
Role Overview
Design and evolve Laurel's global large scale data platform architecture
Design and operate large-scale data pipelines processing millions of events per day.
Define best practices for data ingestion, transformation, processing, and storage.
Mentor and help grow team and our knowledge of big data best practices along with encouraging modern techniques
Work on Python API services (Django) to improve the serving of our AI infrastructure.
Build, improve, and maintain Airflow DAGs, and optimize MongoDB and PostgreSQL usage for data workloads.
Design and operate streaming data infrastructure, including migrations to modern event-driven architectures (e.g., Kafka).
Work on internal OLAP and DataLake systems (e.g. Clickhouse)
Develop and manage Kubernetes, Docker, and compute infrastructure for all of engineering.
Improve continuous integration, continuous deployment, and other automation.
Write backend code to help teams deliver functionality when there are deadlines or resource constraints.
Attend quarterly offsites (required travel), team standups, and other company meetings.
Raise the bar for engineering quality and advocate for best practices across the organization.
Requirements
Strong Python skills with experience building and deploying APIs to support AI/ML teams
Experience with Airflow, Kubernetes, and AWS
Experience with machine learning infrastructure and large language models
Development experience with Terraform
Experience working in startup environments
Experience participating in a regular engineering on-call rotation
Experience with PostgreSQL and MongoDB
Experience with OLAP systems (Snowflake, Clickhouse, etc)
Experience with AI Specific Databases (Vector Databases for example)
Experience with event streaming platforms (e.g., Kafka, SQS)
Tech Stack
Airflow
AWS
Django
Docker
Kafka
Kubernetes
MongoDB
Postgres
Python
Terraform
Benefits
Comprehensive medical/dental/vision coverage with covered premiums
401(k)
Wellness, commuter, and FSA stipends
Apply Now
Home
Jobs
Saved
Resumes