IDR, Inc. is seeking a Sr. Data Engineer to join one of their top clients for a remote opportunity. This role involves building and supporting data pipelines, ensuring data quality, and collaborating across teams to enhance system performance.
Responsibilities:
- Design, develop, and maintain complex data ingestion pipelines and synchronization processes
- Collaborate across teams to ensure seamless data flow and system performance
- Troubleshoot and resolve production incidents related to data pipelines and system performance
- Contribute to architectural decisions, emphasizing scalability, performance, and reliability
- Support data governance, lineage, and ownership practices to uphold data quality standards
Requirements:
- 5+ years building ETL/ELT data pipelines using SSIS or similar tools for data warehouses or data lakes
- Strong SQL Server expertise, including stored procedures, query tuning, and indexing
- Hands-on experience with AWS data services such as S3, Lambda, Glue, Athena, and CloudWatch
- Experience with data ingestion and replication patterns such as full load, incremental, and CDC
- Familiarity with modern data transformation tools like DBT and data governance practices