Key skills
SQLPythonETL pipelinesELT pipelinesSnowflakeApache SparkDatabricksApache AirflowGitJiraCircleCIBazelData EngineeringProduction-Grade Software DevelopmentData Pipeline OrchestrationETLELTSparkAirflowCI/CD
About this role
VideoAmp, Inc. is seeking a Senior Data Engineer to work with linear viewership data. The role involves applying SQL fluency, developing data infrastructure, and collaborating with engineering teams to implement and maintain big data solutions.
Responsibilities:
- Apply fluency in SQL to analyze and model complex linear viewership data
- Develop data infrastructure processing and serving software, primarily written in Python
- Build ETL/ELT streaming and batch pipelines on big data platforms and frameworks, including Snowflake, Spark, and Databricks
- Orchestrating data engineering pipelines with Airflow
- Apply Fluency with modern software development environments and tooling, e.g., Git, Jira, CircleCI (or similar CI/CD), Bazel
- Collaborate with peers within her immediate team and across the larger engineering organization on activities that include distilling engineering designs from product requirements and data science; development of work plans; implementation, testing, productization, monitoring, and maintenance of big data infrastructure
Requirements:
- Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or a related field
- 5 years of experience with Data Engineering
- 5 years of experience developing Production-Grade Software
- 5 years of experience with SQL
- 5 years of experience with Data Pipeline Orchestration
- 3 years of experience with Modern Engineering Stack/Tools
- Fluency in SQL to analyze and model complex linear viewership data
- Develop data infrastructure processing and serving software, primarily written in Python
- Build ETL/ELT streaming and batch pipelines on big data platforms and frameworks, including Snowflake, Spark, and Databricks
- Orchestrating data engineering pipelines with Airflow
- Fluency with modern software development environments and tooling, e.g., Git, Jira, CircleCI (or similar CI/CD), Bazel
- Collaborate with peers within her immediate team and across the larger engineering organization on activities that include distilling engineering designs from product requirements and data science; development of work plans; implementation, testing, productization, monitoring, and maintenance of big data infrastructure
- Must have the authority to work permanently in the U.S