Home
Jobs
Saved
Resumes
Senior Data Engineer at Level Access | JobVerse
JobVerse
Home
Jobs
Recruiters
Companies
Pricing
Blog
Jobs
/
Senior Data Engineer
Level Access
Remote
Website
LinkedIn
Senior Data Engineer
India
Full Time
1 week ago
Visa Sponsorship
Apply Now
Key skills
AWS
DynamoDB
ETL
PySpark
Python
SQL
Unity
AI
ELT
Data Engineering
Analytics
Databricks
dbt
ECS
Fargate
Lambda
S3
IAM
Glue
Athena
REST API
Git
Version Control
CI/CD
About this role
Role Overview
Design, build, and maintain a scalable data platform on Databricks and AWS, following Medallion (Bronze/Silver/Gold) architecture principles.
Develop and manage data ingestion and ETL/ELT pipelines from core business systems, ensuring data quality, reliability, and performance.
Implement data quality monitoring (freshness, completeness, validity, anomaly detection) with automated alerting.
Establish and maintain Golden Record identity resolution and reverse sync across source systems.
Govern metadata, lineage, and permissions using Databricks Unity Catalog and platform standards.
Collaborate with cross-functional teams to deliver analytics
and AI-ready datasets that support business objectives.
Apply best practices for infrastructure as code, CI/CD, and version control for data pipelines.
Communicate effectively with stakeholders, manage ambiguity, and drive results in a fast-paced environment.
Requirements
8+ years of experience in data engineering, building production-grade ETL/ELT pipelines at scale.
Strong proficiency in Python (PySpark, scripting, API integrations, pipeline automation).
Hands-on experience with Databricks (notebooks, jobs, workflows, Unity Catalog) and AWS (Lambda, ECS/Fargate, S3, Glue, Athena, DynamoDB, EventBridge, Step Functions, IAM).
Expertise in data modeling and lakehouse architectures (Medallion, Delta Lake, Parquet, schema evolution, incremental upserts).
Proficiency in SQL and dbt for building modular, tested, and documented models.
Experience with REST API integration, entity resolution, and record matching strategies.
Familiarity with Git-based version control and CI/CD for data pipelines.
Tech Stack
AWS
DynamoDB
ETL
PySpark
Python
SQL
Unity
Benefits
Competitive benefits package
Bonus opportunities
Generous paid time off
Paid holidays
Programs designed to support employee well-being and work-life balance
Apply Now
Home
Jobs
Saved
Resumes