Senior Data Engineer
New York City, New York, United States of America
Full Time
4 hours ago
$167,000 - $200,000 USD
No H1B
Key skills
AirflowPostgresPythonSparkSQLData EngineeringData WarehousingBusiness IntelligenceSnowflakePostgreSQL
About this role
Role Overview
- Build, optimize, and maintain data pipelines that power our business
- Define and build out abstracted reusable data sets to be used for Business Intelligence, Marketing, and Data Science Research
- Design, build, and evangelize a federated data validation frameworks to be used to monitor potential data inconsistencies
- Protect our users’ privacy and security through best practices
Requirements
- 4+ years of software/data engineering experience (distributed data processing, data warehousing, data governance, Big Data, data variance, data privacy, and data quality)
- Expertise in SQL, job experience, and demonstrated strength with Python
- Expertise in building scalable data pipelines, query optimization, data modeling, and defining reusable datasets
- Experience working with orchestration tools (especially Airflow), databases (especially PostgreSQL), datalakes (especially Iceberg), data warehouses (especially Snowflake)
- Expertise with SQL tuning, Spark development, medallion and event-driven architectures.
- Familiarity with healthcare or insurance
- Familiarity with data security and HIPAA compliance
- A desire to be a part of a high-performing, mission-driven team that operates with intense urgency, a strong sense of individual accountability, and a commitment to authentic feedback
Tech Stack
- Airflow
- Postgres
- Python
- Spark
- SQL
Benefits
- flexible PTO
- Medical/Dental/Vision plan options
- 401(k) with company match
- flexible spending accounts
- Teladoc Health and more.