Role: Data Engineer Senior
Location: 301 N. Wilmington St, Raleigh, NC (Hybrid)
Duration: Long-Term Contract
Experience: 10+ Years
Job Summary
We seeking a Senior Data Engineer with strong experience in data engineering, ETL development, and data quality assurance. The primary responsibility is to ensure the integrity, accuracy, and reliability of data as it moves from a shared file transfer service to Amazon S3, through Snowflake, and into downstream applications and reporting systems.
The ideal candidate will have expertise in Python, SQL, cloud technologies, ETL pipelines, and data quality management, along with strong analytical and collaboration skills.
Key Responsibilities
Design, develop, and maintain robust ETL pipelines for data ingestion and transformation.
Implement data quality assurance (QA) and validation processes throughout the ETL lifecycle.
Ensure accurate data movement from shared file transfer services to Amazon S3 and Snowflake.
Monitor, troubleshoot, and optimize data pipelines to maintain reliable data flow.
Identify and resolve data quality issues, including source data inconsistencies that may cause ingestion failures or data rollbacks.
Collaborate with business owners, data analysts, BI teams, and other stakeholders to understand business requirements and deliver high-quality data solutions.
Translate business requirements into scalable technical solutions.
Follow secure coding practices and cybersecurity standards related to data engineering and DevOps.
Support Agile development processes and participate in planning, development, and deployment activities.
Required Qualifications
5+ years of experience in Data Engineering with a strong focus on:
Data Quality Assurance
Data Validation
ETL Development
5+ years of experience with:
Strong understanding of:
Data Quality Management
ETL Architecture
Data Integration
Data Pipeline Monitoring
Experience with:
Amazon S3
Snowflake
Public Cloud platforms
Knowledge of cybersecurity principles related to:
Strong analytical and problem-solving skills.
Ability to gather business requirements and translate them into technical solutions.
Excellent communication and stakeholder collaboration skills.
Experience working in Agile environments.
Preferred Technical Skills
Experience Matrix
Skill
Required
Experience
Data Engineering (ETL & Data Quality)
Required
5+ Years
Python
Required
5+ Years
PyPI
Required
5+ Years
SQL
Required
5+ Years
Cybersecurity Principles
Required
5+ Years
Public Cloud Technologies
Required
5+ Years
Business Requirements Analysis
Required
5+ Years
Agile Development
Required
Preferred