Sr. Data Engineer

Technology Partners is currently seeking a talented Senior Data Engineer. In this role, you will lead the development of ETL processes using Matillion and Redshift, working closely with the Senior Data Architect and DevSecOps Engineer to ensure data integrity and compliance while modernizing data systems.

Responsibilities:

• Develop and optimize Matillion ETL jobs, including orchestration and transformation workflows
• Analyze existing fragmented ETL logic, identify patterns, and consolidate into reusable components
• Build and maintain Redshift reference tables and views that expose site-to-enterprise data mappings
• Implement and validate CDC data ingestion strategies from SQL Server and other sources
• Create automated frameworks for parallel validation of data outputs comparing current and new platform results
• Design and execute reprocessing patterns for approximately 10 years of historical data
• Support the implementation of data integrity checks, including row count, primary key, null thresholds, and checksum validations
• Collaborate with architecture and operations teams to surface integration issues and improve platform stability
• Ensure all data pipelines and processes adhere to security, compliance, and best practice standards

Requirements:

• 7+ years of data engineering experience, with at least 3–5 years of hands-on work in cloud data warehouses
• Recent, practical experience developing with Matillion ETL, including orchestration, transformation, shared libraries, and environment configuration
• Strong proficiency in Redshift, with expertise in SQL query tuning, distribution key, sort key, materialized views, and query optimization
• Experience consolidating fragmented ETL logic into standardized, reusable patterns without supervision
• Hands-on experience with CDC strategies in SQL Server or equivalent data ingestion mechanisms
• Deep understanding of SQL and data modeling for master data, crosswalks, and hierarchical view exposure
• Familiarity with source systems such as SQL Server (CDC-enabled), JDE ERP, MES, and cloud storage techniques
• Ability to work effectively in environments with sparse or outdated documentation
• Bachelor's degree in Computer Science, Data Science, or related field
• Valid compliance or security certifications (e.g., NIST SP 800-171, CMMC Level 2) are a plus
• Prior aerospace, defense, or ITAR-regulated industry experience
• Active certifications in Matillion (Associate or Professional) and AWS (Data Analytics Specialty or Solutions Architect)
• Experience with Qlik Sense or Qlik View ETL development for migration projects
• Knowledge of JDE (JD Edwards) data extraction processes
• Familiarity with manufacturing or shop-floor data systems, MES, and production analytics
• Consulting experience at a Big 4 or top-tier data practice