Key skills
AirflowAmazon RedshiftAWSAzureCloudDockerGoogle Cloud PlatformKubernetesPostgresPythonSQLData EngineeringSnowflakeRedshiftDatabricksdbtGCPGoogle CloudPostgreSQLRepositoryCommunication
About this role
Role Overview
- Learn and build expertise across several software engineering disciplines, including:
- Airflow and data engineering
- Kubernetes
- Cloud Engineering
- Gain exposure to the big picture; learn about product, engineering, customer relationship management, and more.
- Solve challenging Airflow problems for our customers. From optimizing configuration to identifying world-first Airflow bugs, you’ll see it all here.
- Spend up to 25% of your time on side projects that contribute to Astronomer’s overall success, such as contributing to the open-source Airflow repository or developing Astronomer’s internal monitoring and alerting systems built on Airflow.
- Work on a modern, sophisticated, cloud-native product that customers use to connect to dozens of other systems. Gain depth and breadth of learning!
- Work directly with our customers’ data engineers, system admins, DevOps teams, and management.
- Provide feedback from your experience that can shape the direction of the Airflow project.
- Own the customer experience, working directly with customers to prioritize and solve issues, meet SLAs, and provide “white glove” guidance on the path to production.
Requirements
- Data Engineering background
- 4 years of experience with Python
- 1 year of experience with Kubernetes/Docker/Containers
- Experience working with a distributed system with any major cloud provider (AWS, GCP, Azure)
- Problem-solving and troubleshooting abilities
- Ability to work well with autonomy and independence
- Strong written and verbal communication for connecting with our customers over our ticketing system and through Zoom
- Bonus points if you have:
- Experience in Airflow administration and DAG creation
- Contributions to open-source projects
- Customer Support experience
- Familiarity with SQL and PostgreSQL
- Experience with Databricks, Snowflake, Redshift, dbt, or other similar data engineering tools.
Tech Stack
- Airflow
- Amazon Redshift
- AWS
- Azure
- Cloud
- Docker
- Google Cloud Platform
- Kubernetes
- Postgres
- Python
- SQL
Benefits
- Paid time off
- Participate remotely within a fully distributed team
- Help maintain 24x7 coverage through a specified 6-hour pager period during your work day.
- Participate in paid on-call rotation for weekend coverage.