The Points Guy is seeking a Data Engineer to build data products and create the foundation for machine learning and business analytics. The role involves designing and building data pipelines, working with various stakeholders, and implementing scalable data solutions.
Responsibilities:
- Design and build data pipelines from various sources to data warehouse using batch or incremental loading strategies utilizing cutting edge cloud technologies
- Conceptualizing and generating infrastructure that allows data to be accessed and analyzed effectively
- Engineer reliable data pipelines - Implement Python/Spark jobs, dbt transformations, and Orchestration with CI/CD (GitHub Actions, Terraform)
- Partner with analytics and product teams to translate business needs into scalable data models and solutions
Requirements:
- 3+ years of experience working with SQL
- 3+ years of experience performing production data engineering/ETL work
- 3+ years of experience with one of the major cloud providers (we use AWS but we welcome candidates with experience in Azure or GCP)
- 3+ years of experience working on Spark/SparkSQL using Scala/Python to build and maintain complex ETL pipelines
- Experience with GitHub and CI/CD processes
- Experience working on Orchestration (Databricks Workflows / Airflow)
- Experience with one of the major data warehousing solutions (we use Databricks but we welcome candidates with experience in BigQuery, Snowflake, Oracle or Redshift)
- Conceptual understanding of data warehousing and dimensional modeling
- Experience providing operational support for the production data pipelines and data triaging
- Must be located in the Eastern or Central Time Zone and be based in the United States
- This role is not open to visa sponsorship or transfer of visa sponsorship including those on H1-B, F-1, OPT, STEM-OPT, or TN visa, nor is it available to work corp-to-corp
- Familiarity with SaaS like Fivetran and Hightouch is a plus