Design and implement robust data architectures supporting structured and unstructured data from internal and external sources
Build and maintain scalable, secure data pipelines using cloud-based and distributed technologies
Establish data structures and routing mechanisms based on business and technical requirements
Develop and execute automated test cases to validate ETL workflows, data pipelines, and reporting logic
Create regression test suites to ensure ongoing data integrity and system stability
Analyze current and historical performance data to identify trends, variances, and opportunities
Collaborate with data consumers, project managers, and business stakeholders to define logical and physical database designs for analytics models
Identify and implement improvements in internal data management and testing processes
Requirements
Bachelor’s degree in a related discipline and 4 + years of experience in data engineering or architecture
Proven experience designing and building data pipelines and architectures in cloud environments (e.g., AWS, Azure, Snowflake)
Strong programming skills in Python, Scala, or Java, and proficiency in SQL
Experience with big data technologies (e.g., Spark, Kafka, Hadoop) and machine learning frameworks
Familiarity with ETL processes, data modeling, and data warehousing concepts
Experience with automated testing frameworks (e.g., PyTest, Selenium, dbt tests) and data validation techniques
Excellent problem-solving skills and ability to communicate technical concepts to non-technical stakeholders
Experience supporting cross-functional teams including Finance, Sales, and Product Development is a plus.
Tech Stack
AWS
Azure
Cloud
ETL
Hadoop
Java
Kafka
Python
Scala
Selenium
Spark
SQL
Benefits
The Company offers eligible employees the flexibility to take as much vacation with pay as they deem consistent with their duties, the company’s needs, and its obligations
Seven paid holidays throughout the calendar year
Up to 160 hours of paid wellness annually for their own wellness or that of family members
Additional paid time off in the form of bereavement leave