Senior Data Engineer
United States
Full Time
2 weeks ago
Visa Sponsor
Key skills
Amazon RedshiftApacheAWSCloudCyber SecurityETLPythonSQLData EngineeringAnalyticsRedshiftLambdaS3RDSGlueKinesisAgileCI/CDCollaboration
About this role
Role Overview
- Design, implement, and maintain data pipelines and ETL processes supporting ingestion, transformation, and validation of mission data.
- Develop and optimize data models and schemas across relational and non-relational databases to support system integrations and analytics.
- Collaborate with system architects, integration developers, and data analysts to ensure data consistency, security, and integrity across cloud environments.
- Implement data migration and synchronization between legacy systems, applications, and modern cloud platforms.
- Utilize AWS services (Glue, Lambda, S3, RDS, Redshift, Kinesis) to build and sustain scalable and fault-tolerant data infrastructure.
- Support data validation and reconciliation, performing quality checks and developing reports to ensure accuracy.
- Integrate data from APIs, streaming sources, and file-based systems into centralized repositories or data lakes.
- Automate data workflows using infrastructure-as-code and CI/CD principles to ensure repeatability and efficiency.
- Monitor and troubleshoot data pipeline performance, ensuring adherence to SLAs and operational reliability.
- Implement data encryption, masking, and access controls in compliance with DoD cybersecurity policies and RMF requirements.
- Support development of dashboards and analytics products, enabling data-driven insights for mission stakeholders.
- Maintain documentation and metadata repositories, including data dictionaries, lineage, and technical specifications.
- Participate in Agile sprints, contributing to backlog refinement, testing, and cross-functional collaboration.
Requirements
- Minimum 7 years of experience in data engineering, integration, or analytics enablement.
- Proficiency with Python, SQL, and ETL frameworks (e.g., Apache NiFi, Talend, or AWS Glue).
- Experience with cloud data services, preferably AWS GovCloud (RDS, S3, Lambda, Glue, Redshift).
- Bachelor's degree in Computer Science, Information Systems, or a related technical field.
- Familiarity with Agile software development and DevSecOps delivery frameworks.
- Related technical certification required.
Tech Stack
- Amazon Redshift
- Apache
- AWS
- Cloud
- Cyber Security
- ETL
- Python
- SQL
Benefits
- N/A