Key skills
AWSPandasPySparkPythonSQLTerraformVaultData EngineeringAnalyticsdbtCloudFormationCI/CD
About this role
Role Overview
- Architect production-grade, fault-tolerant batch and real-time data pipelines within a compliance-governed AWS environment.
- Lead data modeling (dimensional, SCD, data vault) and build API/file-based integrations with encryption and audit logging at every point.
- Build CI/CD pipelines for data infrastructure with mandatory security scanning and approval gates.
- Conduct code reviews, mentor engineers, and produce technical documentation including ADRs, runbooks, and compliance evidence packages.
Requirements
- Bachelor’s degree in Computer Science, Data Engineering, or related field; 7+ years in Analytics/Data Engineering.
- Expert SQL and Python (PySpark, Pandas, Boto3); deep AWS experience across the data, security, and governance stack.
- Demonstrated experience implementing governance frameworks and regulatory compliance controls (HIPAA, SOC 2, GDPR, CCPA) in production.
- Experience with IaC (CloudFormation, Terraform, CDK), CI/CD for data pipelines, and data security principles.
- AWS certifications (Data Analytics Specialty, Security Specialty, Solutions Architect Professional) preferred.
- Experience with data quality frameworks (Great Expectations, dbt, Monte Carlo), and regulated industries (healthcare, financial services).
Tech Stack
- AWS
- Pandas
- PySpark
- Python
- SQL
- Terraform
- Vault
Benefits
- bonus
- benefits