Lead Data Engineer

Adelaide is hiring a Lead Data Engineer to lead its data engineering team and own the design, reliability, and performance of its data pipelines and infrastructure. The role supports data flowing from internal and external sources into Adelaide’s SaaS analytics dashboard and connected platforms, and supervises one Data Engineer.

Responsibilities:

• Structure a sophisticated network and pipeline of data across internal and external sources
• Maintain a high degree of uptime for our SaaS analytics dashboard and connected platforms
• Work with other team members to design, build, deploy, and maintain reliable data pipelines
• Maintain and optimize existing data pipelines and integrations
• Optimize our data stores for fast, efficient querying to support technology and reporting needs
• Ensure the quality, reliability, and security of our data infrastructure

Requirements:

• Bachelor's degree in Computer Science
• Proficiency in Python, Redshift, Postgres, SQL, Spark, Scala, and Airflow
• Experience with the Pandas library and Docker
• Familiarity with AWS technologies such as ECS, S3, Kinesis, Redshift, and EMR
• Strong understanding of data structures and algorithms
• Experience with machine learning
• Passion for delivering high-quality, reliable data solutions
• Experience in ad tech, measurement, or verification
• Experience with high-throughput or near-real-time data pipelines
• Experience with Snowflake or Looker