Data Engineer

ITnova is seeking Data Engineer / Developers to support the Port Authority of New York and New Jersey’s Aviation Department. The role develops and maintains cloud-based data pipelines, ELT workflows, data warehouse solutions, Power BI models, data quality checks, and governed data entry applications for the Aviation Data Analytics Warehouse.

Responsibilities:

• Develop new and maintain existing data pipelines within ADAW, including configuring automated data extraction processes and troubleshooting ingestion failures and data source connectivity issues
• Design, build, and maintain Extract, Load, Transform (ELT) workflows, including standardizing and cleansing data according to PANYNJ data governance standards and business rules
• Develop reusable data transformation frameworks in Azure Synapse Analytics and optimize pipeline performance and data processing
• Create, maintain, and manage database objects, including tables, views, and stored procedures, to support Azure Synapse serverless and dedicated SQL pools and SQL Server databases
• Design, develop, and maintain efficient Power BI semantic models to support business intelligence, reporting, and analytics requirements
• Develop and maintain front-end data entry applications, including Microsoft Power Apps, to support secure, streamlined, and governed data entry workflows within the ADAW ecosystem
• Develop and maintain automated daily data quality checks to identify anomalies and inconsistencies, investigate root causes, and escalate issues to the Data Engineering team
• Validate dashboards and reports against business requirements, verifying calculations, data fields, and reported results for accuracy and consistency
• Collaborate with the Data Engineering team, business stakeholders, and other technical teams to troubleshoot issues and support ongoing platform enhancements
• Document data pipelines, transformation logic, database objects, data quality rules, and technical processes

Requirements:

• Experience developing and maintaining data pipelines, data integrations, and ELT workflows
• Experience with Microsoft Azure data services, including Azure Synapse Analytics, Azure Data Factory, Azure SQL, and/or Databricks
• Strong SQL skills, including developing and maintaining tables, views, stored procedures, and other database objects
• Experience with data transformation, cleansing, standardization, and applying business rules to data
• Experience working with relational databases and data warehouse environments, including SQL Server
• Experience designing or maintaining Power BI semantic models and supporting business intelligence and reporting requirements
• Experience troubleshooting data pipeline failures, data connectivity issues, and data quality problems
• Strong analytical and problem-solving skills, attention to detail, and the ability to investigate data discrepancies and identify root causes
• Ability to document technical solutions and collaborate effectively with technical teams and business stakeholders
• Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder)
• Experience with Azure Synapse serverless and dedicated SQL pools
• Experience developing reusable data transformation frameworks and optimizing ELT pipeline performance
• Experience with Microsoft Power Apps or other front-end data entry application development
• Experience implementing automated data quality checks, anomaly detection, and data validation processes
• Experience validating Power BI dashboards and reports against business requirements and verifying calculations and data fields
• Familiarity with data governance standards, data quality rules, and controlled data entry workflows
• Experience with Azure DevOps, Agile development practices, version control, testing, and deployment processes
• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field