Azure AI Data Engineer

ICF is seeking an Azure AI Data Engineer to join their team. This role involves data development tasks to collect, store, validate, and process large datasets in the Azure environment, with a focus on enhancing data engineering processes and capabilities.

Responsibilities:

• Monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance, leveraging AI-driven anomaly detection and predictive insights to proactively identify and resolve issues
• Keeping abreast of the latest Azure features and technologies to enhance data engineering processes and capabilities, with a strong focus on emerging AI services, generative AI, and intelligent data platforms to drive innovation
• Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks
• Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information
• Collaborating with data scientists, business analysts, and other stakeholders to understand data requirements and implement appropriate data solutions
• Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards

Requirements:

• Bachelor's degree in Computer Science, Engineering, Data Science, Math, Energy, or related technical fields
• 5+ years of hands-on experience designing, developing, and supporting database and data engineering solutions within an Azure-based environment, including work across the full SDLC in an Agile or product-focused team or related work experience
• Experience designing, developing, and integrating AI-driven solutions, including building AI agents or intelligent workflows that enhance data pipelines, automation, analytics, or decision support within an Azure-based environment
• Strong experience with Azure data services such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, and Azure SQL Data Warehouse, along with advanced SQL, data modeling, data pipeline automation, performance tuning, and data quality management
• Must be able to pass a background check, have a valid driver's license, and successfully pass a Motor Vehicle Records (MVR) check and drug screening
• Ability to work in a distributed team environment
• Experience working on quantitative software products
• An outstanding academic record with a focus on Energy, Science, Math, and Engineering or similar