Higher LogicRemote
Data Solutions Engineer
United States of America
Full Time
3 weeks ago
H1B Sponsor Likely
Key skills
Data EngineeringData ArchitectureAWSS3AWS GlueDatabricksPostgresMSSQLStreaming PipelinesData ModelingData Warehouse Performance TuningELT PatternsData GovernanceData Quality FrameworksData Lineage SystemsTerraformCI/CDGitHub ActionsETLELTAnalyticsBIPower BIdbtGlueGitHubSaaSMentoringCommunication
About this role
Higher Logic exists to connect people, knowledge, and ideas to improve lives and organizations. They are looking for a Data Engineer / Data Architect to design and build the next generation of their data platform, focusing on architecting scalable data systems that power analytics and customer insights.
Responsibilities:
- Architect and build new data pipelines and lakehouse patterns to handle ~1 TB/day of streaming and batch data
- Establish data governance and lineage foundations, designing systems that make data traceable from source through warehouse and back into our platforms
- Build and optimize pipelines that power both analytics (Power BI) and operational workloads (e.g., marketing automation)
- Design performant warehouse schemas and ETL/ELT processes for analytical and reverse ETL use cases
- Lead performance and cost optimization initiatives across Glue, Databricks, and S3
- Implement data quality, documentation, and testing frameworks using dbt
- Develop infrastructure as code using Terraform and automate deployments through GitHub Actions
- Partner closely with analysts, platform teams, and business stakeholders to enable data visibility, traceability, and self-service analytics
- Act as a senior member of the data team, setting best practices, mentoring others, and helping shape the data platform’s future
Requirements:
- 5+ years of experience in data engineering, including architecting scalable data platforms in AWS
- Deep hands-on experience with S3, Glue, Databricks, Postgres/MSSQL, and streaming pipelines
- Strong background in data modeling, warehouse performance tuning, and ELT patterns
- Demonstrated experience implementing data governance, quality frameworks, and ideally designing lineage systems
- Proficiency with Terraform and CI/CD (GitHub Actions) for data infrastructure
- Excellent communication skills — able to translate business needs into data architecture
- Comfortable operating as a senior team member in a growing data org, influencing architecture and mentoring others
- Experience with tools like OpenMetadata, DataHub, or Collibra for lineage and cataloging
- Exposure to reverse ETL patterns and marketing automation platforms
- Certifications in AWS Data, Databricks, or related fields
- Experience in multi-tenant or high-scale SaaS environments