Adaptive Solutions Group is seeking a Senior Data Engineer for their top client in the transportation industry. In this role, you will develop and optimize scalable ETL/ELT processes to support cloud-based technologies and collaborate with cross-functional teams to deliver reliable data solutions.
Responsibilities:
- Design, build, and maintain scalable data pipelines and integration solutions to support enterprise data platforms
- Develop and optimize ETL/ELT processes to ensure efficient data transformation and movement across systems
- Create and maintain source-to-target mappings and detailed ELT documentation
- Perform data analysis, mapping, and troubleshooting across all stages of the data pipeline lifecycle
- Collaborate with cross-functional teams to deliver high-quality, reliable data solutions
- Provide accurate estimates for development efforts and recommend process improvements
- Support production data processes, including participation in on-call rotation as needed
- Contribute to CI/CD processes and support DevOps best practices within data workflows
Requirements:
- Must be presently authorized to work in the U.S. without a requirement for work authorization sponsorship by our company for this position now or in the future
- Must currently reside in one of the following states: AL, AZ, FL, GA, ID, IL (excludes Cook County), IA, IN, KS, KY, LA, MD, MI, MO, NV, NM, NC, OH, OK, PA, SC, TN, TX, UT, VA, WV, WI
- Must be able to work a schedule within U.S. Central Standard Time core business hours
- 3+ years of hands-on experience with ETL for data integration and transformation
- 3+ years of experience writing and tuning complex SQLs, stored procedures, triggers, functions, and error trapping
- 3+ years of experience in full lifecycle development and end-to-end testing and data validation
- Experience with Matillion
- Experience working with cloud-based data platforms and pipeline orchestration tools
- Strong experience with AWS services, including serverless compute and data pipeline orchestration
- Experience implementing Change Data Capture (CDC) strategies
- Familiarity with CI/CD pipelines and DevOps tools (e.g., Git-based workflows)
- Bachelor's degree in Computer Science, Information Systems, Engineering, or related field
- Experience with data quality frameworks and unit testing for data pipelines
- Strong ability to optimize queries for large-scale datasets
- Experience integrating data workflows with CI/CD pipelines
- Familiarity with Agile/Scrum methodologies and DevOps principles
- Ability to mentor junior team members and contribute to small project leadership