Lead the design and implementation of scalable, robust data architectures supporting enterprise-level data solutions
Design, build, and maintain complex ETL/ELT pipelines integrating data from diverse sources (APIs, cloud platforms, databases)
Own and deliver high-impact, complex data engineering projects end-to-end
Provide technical leadership and mentorship to junior and mid-level data engineers
Establish and enforce data engineering best practices, standards, and governance
Collaborate with cross-functional teams and client engineering teams to define data integration strategies and requirements
Monitor, troubleshoot, and optimize data pipeline performance, scalability, and reliability
Drive improvements in data quality, observability, and operational efficiency
Ensure data security, privacy, and compliance through proper architecture and Azure policies
Requirements
Bachelor’s degree in computer science, information systems, or a related field
6+ years of experience in cloud data architecture, design and data governance
Strong experience with Azure cloud services, such as Azure Data Lake Storage, Azure Data Factory, and Azure Synapse
Proficiency in programming languages, such as SQL, Python, Scala, or Java
Experience with big data processing frameworks, such as Apache Spark, Hadoop, or Apache Kafka on Azure
Knowledge of various data storage solutions, such as relational databases, etc.
Creating & Managing documentation on methodologies, tools and techniques
Strong analytical problem-solving and the ability to explain complex technical designs to non-technical stakeholders
Proven ability to lead complex projects and mentor team members
Willing and able to work irregular hours as needed
Tech Stack
Apache
Azure
Cloud
ETL
Hadoop
Java
Kafka
Python
Scala
Spark
SQL
Benefits
Free premium medical, dental, life and vision insurance
Generous 401(k) match
Aya also offers other benefits to those that are eligible and where required by applicable law, including reimbursements and discretionary bonuses
Aya provides paid sick leave in accordance with all applicable state, federal, and local laws. Aya’s general sick leave policy is that employees accrue one hour of paid sick leave for every 30 hours worked. However, to the extent any provisions of the statement above conflict with any applicable paid sick leave laws, the applicable paid sick leave laws are controlling
Celebrations! We hit our goals and reward ourselves.
Company-sponsored virtual events, happy hours and team-building activities are always on the horizon — plus, you get a special treat on your birthday!
Unlimited DTO — we believe in time off!
Virtual yoga, meditation or boot camp classes offered daily