Monitor and troubleshoot data pipeline and warehouse quality and performance issues, ensuring smooth operation and proactively addressing potential bottlenecks
Design, build, and maintain scalable ETL/ELT pipelines to transfer data to and from clients from diverse sources, such as APIs, cloud storage, and databases
Collaborate with client engineering teams to understand their data structures, identify source systems, and contribute to technical integration requirements
Stay updated with industry trends and advancements in data engineering and bring innovative ideas to continuously improve our data processes
Ensure data security, privacy, and compliance by implementing appropriate Azure policies, procedures, and encryption methods
Monitor and optimize the performance, scalability, and cost-efficiency of data storage and processing solutions on Azure

Bachelor’s degree in computer science, information systems, or a related field
2+ years of experience in cloud data architecture, design and data governance
Strong experience with Azure cloud services, such as Azure Data Lake Storage, Azure Data Factory, and Azure Synapse
Proficiency in programming languages, such as SQL, Python, Scala, or Java
Experience with big data processing frameworks, such as Apache Spark, Hadoop, or Apache Kafka on Azure
Knowledge of various data storage solutions, such as relational databases, etc.
Creating & Managing documentation on methodologies, tools and techniques
Strong analytical problem-solving and the ability to explain complex technical designs to non-technical stakeholders
Willing and able to work irregular hours as needed

Free premium medical, dental, life and vision insurance
Generous 401(k) match
Aya also offers other benefits to those that are eligible and where required by applicable law, including reimbursements and discretionary bonuses
Aya provides paid sick leave in accordance with all applicable state, federal, and local laws. Aya’s general sick leave policy is that employees accrue one hour of paid sick leave for every 30 hours worked. However, to the extent any provisions of the statement above conflict with any applicable paid sick leave laws, the applicable paid sick leave laws are controlling
Celebrations! We hit our goals and reward ourselves.
Company-sponsored virtual events, happy hours and team-building activities are always on the horizon — plus, you get a special treat on your birthday!
Unlimited DTO — we believe in time off!
Virtual yoga, meditation or boot camp classes offered daily

Data Engineer

Key skills