Data Engineer (Azure) ($45/hr)

New York Technology Partners is seeking a highly skilled Senior Data Engineer to join a distributed team responsible for building and supporting enterprise-scale data platforms. This role involves designing, developing, and maintaining scalable, high-performance data solutions within the Azure ecosystem, while collaborating with both onshore and offshore teams.

Responsibilities:

• Collaborate with globally distributed engineering teams to deliver scalable and reliable data solutions
• Design and implement enterprise-grade data models to support analytics and reporting needs
• Build, optimize, and maintain data pipelines using Azure Databricks, PySpark, and Azure Data Factory
• Develop and enhance data warehouse architectures for business intelligence and advanced analytics
• Ensure high standards of data quality, integrity, performance, and reliability across all data platforms
• Support data ingestion, transformation, and preparation for AI/ML use cases
• Participate in Agile/Scrum ceremonies and contribute to continuous improvement initiatives

Requirements:

• Python: 5+ years of hands-on development experience
• SQL: 6–8 years of experience writing complex queries and optimizing performance
• Data Modeling: 5+ years designing and implementing enterprise-level data models
• Strong experience with Azure cloud data services
• Hands-on experience with Azure Databricks
• PySpark: 5–7 years building scalable data processing and transformation pipelines
• Experience developing and orchestrating workflows using Azure Data Factory
• Experience with Apache Airflow or similar orchestration tools
• Exposure to or experience supporting AI/ML data pipelines
• Experience working in Agile/Scrum environments
• Proven ability to collaborate effectively with globally distributed teams