Senior Data Engineer

Nerdery is hiring a Senior Data Engineer to design and implement data architecture, storage solutions, and analytics platforms that drive business insights. The role focuses on building scalable, well-governed data platforms on AWS and migrating legacy infrastructure to modern cloud environments.

Responsibilities:

• Design and implement end-to-end data pipelines and ETL/ELT processes
• Architect scalable data platforms using patterns such as medallion/multi-hop, data mesh, or lakehouse
• Migrate data infrastructure from on-premise or hybrid environments to AWS
• Manage and optimize AWS data services including Redshift, Glue, EMR, and Kinesis
• Develop data-processing logic using Python (Pandas, PySpark, Polars) and advanced SQL
• Automate data workflows using orchestration tools like Airflow/MWAA and Step Functions
• Implement Infrastructure-as-Code (Terraform/CloudFormation) and CI/CD for data workloads

Requirements:

• Bachelor's degree in Computer Science, Data Engineering, or a related field (or equivalent practical experience)
• 6+ years of professional experience in data engineering or a closely related discipline
• In-depth knowledge of Snowflake, including warehouse design, role-based access control, performance tuning, and cost optimization
• Advanced proficiency with dbt for modular, tested, and version-controlled data transformations
• Hands-on experience with Dagster for pipeline orchestration, asset management, and data observability
• Proven experience designing and implementing data pipelines, data storage solutions, and analytics platforms on modern cloud data stacks
• Experience migrating data pipelines and infrastructure to Snowflake from other platforms (legacy warehouses, on-premise systems, or hybrid environments)
• Advanced proficiency in Python with hands-on experience in data-processing libraries such as Pandas, Polars, PySpark, or similar
• Strong SQL skills across both analytical and transactional workloads
• Experience with relational and/or columnar databases such as PostgreSQL, SQL Server, or Snowflake
• Deep understanding of data modeling, ETL/ELT processes, and data warehousing principles
• Experience implementing data architecture patterns (e.g., medallion/multi-hop, data mesh, lakehouse) to support scalable, well-governed data platforms
• Familiarity with Infrastructure-as-Code tools such as Pulumi or Terraform
• Familiarity with event-driven architectures and integrating orchestration platforms with cloud services
• Strong version-control practices (Git) with experience building CI/CD workflows for data workloads (e.g., GitHub Actions)
• Proven ability to translate business and technical requirements into production-grade, maintainable data pipelines
• Excellent problem-solving and analytical skills
• Ability to communicate clearly with both technical and non-technical stakeholders
• Proactive collaborator who mentors colleagues and raises the technical bar across the team
• Experience building and consuming RESTful APIs
• Excels at translating deep customer understanding into impactful work, ensuring that every project and decision delivers exceptional user value
• Able to effectively explain technical decisions to non-technical stakeholders
• Relentlessly unravels complex problems, developing innovative solutions to overcome any challenge that stands in the way of progress
• Builds trust by consistently upholding high standards in all work and advocating for the right approach, ensuring quality and transparency
• Actively elevates the team's capabilities by fostering a collaborative environment, sharing knowledge, and prioritizing collective success over individual credit
• Takes full accountability for an initiative's entire lifecycle, from concept to completion, ensuring the final result successfully achieves its intended goals
• Driven by a passion for their craft to continuously learn, deepen their expertise, and strive for excellence in their chosen field
• Must be legally authorized to work within the country of employment without sponsorship for employment visa status
• Familiarity with data quality and observability tooling (e.g., dbt tests, Great Expectations, Monte Carlo) is desirable